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' Abstract. It is folklore particularly in numerical and computer sciences that, instead of solving 

I some general problem f : A ^ B, additional structural information about the input x G A (that 

■ is any kind of promise that x belongs to a certain subset A' C A) should be taken advantage 
^SJ ' of. Some examples from real number computation show that such discrete advice can even make 

, the difference between computability and uncomputability. We turn this into a both topological 

^ ■ and combinatorial complexity theory of information, investigating for several practical problems 

' how much advice is necessary and sufficient to render them computable. 

Specifically, finding a nontrivial solution to a homogeneous linear equation A - x — for a given 

^ ^ ' singular real n x n-matrix A is possible when knowing rank(y4) G {0, 1, . . . , n — 1}; and we show 

' this to be best possible. Similarly, diagonalizing (i.e. finding a basis of eigenvectors of) a given 

. real symmetric n x n-matrix A is possible when knowing the number of distinct eigenvalues: 

r \ ' an integer between 1 and n (the latter corresponding to the nondegenerate case). And again we 

I show that n-fold (i.e. roughly log n bits of) additional information is indeed necessary in order to 

■ render this problem (continuous and) computable; whereas for finding some single eigenvector 
I of A, providing the truncated binary logarithm of the least-dimensional eigenspace of A — i.e. 

, (Llc>g2 "-J + l)-fold advice — is sufficient and optimal. 
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1 Introduction 

Recursive Analysis, that is Turing's [Turi36] theory of rational approximations with prescrib- 
able error bounds, is generally considered a very realistic model of real number computation 
[BrCo06]. Much research has been spent in 'effectivizing' classical mathematical theorems, 
that is replacing mere existence claims 

i) "/or all X, there exists some y such that ..." with 

ii) "/or all computable x, there exists some computable y such that ..." 

Cf. e.g. the Intermediate Value Theorem in classical analysis [WeihOO, Theorem 6.3.8.1] or the 
Krein-Milman Theorem from convex geometry [GeNe94]. Note that Claim ii) is non-uniform: 

it asserts y to be computable whenever x is; yet, there may be no way of converting a Turing 
machine M computing x into a machine N computing y [WeihOO, Section 9.6]. In fact, 
computing a function f : x y is significantly limited by the sometimes so-called Main 
Theorem, requiring that any such / be necessarily continuous: because finite approximations 
to the argument x do not allow to determine the value f{x) up to absolute error smaller 
than the 'gap' limsup^^,^. /(^) — lim inf^^^: /(^) in case x is a point of discontimiity of /. 
In particular any non-constant discrete-valued function on the reals is uncomputable — for 
information-theoretic (as opposed to recursion-theoretic) reasons. Thus, Recursive Analysis is 
sometimes criticized as a purely mathematical theory, rendering uncomputable even functions 
as simple as Gaufi' staircase [KoepOl]. 

1.1 Motivating Examples 

On the other hand many applications do provide, in addition to approximations to the con- 
tinuous argument x, also certain promise or discrete 'advice'; e.g. whether x is integral or 
not. And such additional information does render many otherwise uncomputable problems 
computable: 

Example 1. The Gaufi staircase is discontinuous, hence uncomputable. Restricted to inte- 
gers, however, it is simply the identity, thus computable. And restricted to non-integers, it is 
computable as well; cf. [WeihOO, EXERCISE 4.3.2]. Thus, one bit of additional advice (^"integer 
or not ") suffices to make [ • J : M ^ Z computable. 

Also many problems in analysis involving compact (hence bounded) sets are discontimious 
unless provided with some integer bound; compare e.g. [WeihOO, Section 5.2]. For a more 
involved illustration from computational linear algebra, we report from [ZiBr04, Section 3.5] 
the following 

Example 2. Given a real symmetric dx d matrix A (in form of approximations An G Q''^'^ 
with \A — An\ < it is generally impossible, for lack of continuity and even in the 

multivalued sense, to compute (approximations to) any eigenvector of A. 
However when providing, in addition to A itself, the number of distinct eigenvalues (i.e. not 
counting multiplicities) of A, finding the entire spectral resolution (i.e. an orthogonal basis of 
eigenvectors) becomes computable. 

Another case study on the benefit of additional discrete advice to uniform computability is 
taken from [RoZiOS, Lemma 2.8]: 
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Example 3. A closed subset A C. 'R'^ is called -computable if one can, given x G M"^, 
approximate the distance 

dA{x) = min I ||a; — a||2 : a G A} (1) 

from below; more formally: upon input of a sequence G Q"^ with \\x — q„|| < 2~"', output 
a sequence pm G Q with sup^pm = dA{x); compare [WeihOO, Section 5.1]. Similarly, ij^- 
computability of A means approximation of dA from above. 

a) A finite set A = {vi, . . . ,vn} C is tj^ -computable iff it is ip^ -computable iff each 
element vi is computable. 

b) Neither of the three non-uniform equivalences in a) holds uniformly. 

c) However if the cardinality of A is given as additional information, ijJ^-computability be- 
comes uniformly equivalent to computability of A's members 

d) whereas if^ -computability still remains uniformly strictly weaker than the other two. 



Fig. 1. The convex hull of some points in 2D. Infinitesimal perturbation can heavily affect the (number and) 
subset of extreme points. 



Our next example treats a standard problem from computational geometry [BKOS97, Sec- 
tion 1.1]: 

Example 4. For a set S C W^, its convex hull is the least convex set containing S: 

cliull(5) := {C : 5 C C C M'^, C convex] . 

A polytope is the convex hull of finitely many points, cliull({pi, . . . ,PAr}). For a convex set 
C, point p & C is called extreme (written "p G ext(C) ") if it does not lie on the interior of 
any line segment contained in C: 

p = X- X -\- {1 - X) ■ y A x,y e C A < X < 1 =^ x = y. 

The problem 

extchullAT • ( ^ ) ^ {^1' ■ ■ ■ i^n} ^ {y extreme point of chull(a;i, . . . ,xn)] (2) 

of identifying the extreme points of the polytope C spanned by given Xi, . . . ,xn, is discontin- 
uous ( and hence uncomputable ) already in dimension d = 2 and for N = 3 with respect to 

output encoding ijx^, cf. Figure 1: 

Let Xi := (0,0), 032 := (IjO), and x^ := {\,e): For e = 0, these points get mapped to 
{(0, 0), (1, 0)}; whereas for e 7^ 0, the set of extreme points is {(0, 0), (1, 0), , e)}. 



Real Computation with Least Discrete Advice: A Complexity Theory of Nonuniform Computability 



3 



Trivially, extchullTv does become computable when giving, in addition to approximations to 
the points Xi, . . . , x^, one bit bi G {0, 1} for each i = 1, . . . , N (that is, totally and in binary 
an integer between and 2^ — 1) indicating whether Xi G extchull(a;i, . . . , ccjv)- However 
in Proposition 19 below wc shall show that, in order to compute extchullAr, it suffices to 
know merely the number M G {2, . . . , A''} of extreme points of chull(a;i, . . . , xn) — and that 
{N — l)-fold discrete advice is in fact necessary. 

1.2 Complexity Measure of Non- Uniform Computability 

We are primarily interested in problems over real Euclidean spaces W^, d G N. Yet for rea- 
sons of general applicability to arbitrary spaces U of continuum cardinality, we borrow from 
Wcihrauch's TTE framework [WcihOO, Section 3] the concept of a so-called representation, 
that is an encoding of all elements u £ U as infinite binary strings; and a realizer of a function 
f : U ^ V maps encodings oi u e U to encodings of f{u) G F. A notation is basically a 
representation of a merely countable set. Providing discrete advice to / amounts to presenting 
to the Turing machine, in addition to an infinite binary string encoding u £ U, some integer 
(or 'colour') i; and doing so for each u, means to color U. Now it is natural to wonder about 
the least advice (i.e. the minimum number of colors) needed: 

Definition 5. a) A function f -.C. A B between topological spaces A and B is /c-continuous 
if there exists a covering (equivalently: a partition) A o/dom(/) = IJ^^g^ D with Card(/A) = 
k such that flo is continuous for each D E A. 

Colt <tt{f) '.= min{A; : / is k-continuous} the cardinal of discontinuity of /. 

b) A function f :C. A ^ B between represented spaces (A, a) and {B, j3) is (a, /3)-computable 
with /c-wise advice (or simply fc-computable if a, (3 are clear from the context) if there ex- 
ists an at most countable partition A of Card(zi) = k and a notation S of A such that the 
mapping f^ '■ {ci,D) i— > /(a) is {a, 5, (3) -computable on dom(/^) := {{a,D) : a £ D £ A}. 
Call <tc{f) = <tc(f,a,P) := mm{k : f is {a, P) -computable with k-wise advise} the com- 
plexity of non- uniform (a, /3)-computability of /. 

c) A function f :C. A ^ B is nonuniformly (a, P) -computable if, for every a-computable 
a G dom(/), /(a) is (3 -computable. 

So continuous functions are exactly the 1-continuous ones; and computability is equivalent 
to computability with 1-wise advice. Also we have, as an extension of the Main Theorem of 
Recursive Analysis, the following immediate 

Observation 6. If a, [3 are admissible representations in the sense of [WeihOO, Defini- 
tion 3.2.7], then every k-wise {a, (3) -computable function is k-continuous (but not vice 
versa); that is £t(/) < ^c(/) holds. 

More precisely, every k-wise (a, P) -computable possibly multivalued function f -.C. A ^ B has 
a k-continuous {a, P) -realizer in the sense of [WeihOO, Definition 3.1.3.4]. 

The above examples illustrate some interesting discontinuous functions to be computable 
with A;- wise advice for some A; G N. Specifically Example 2, diagonalization of real symmetric 
n X n-matrices is n-computable; and Theorem 38 below will show this value n to be optimal. 

t We arc grateful for having been pointed out that the Continuum Hypothesis is not needed in order to make 
this minimum well-defined. Anyway, in the following examples it will be at most countable, usually even 
finite. 
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Remark 7. We advertise Computability with Finite Advice as a generalization of classical 
Recursive Analysis: 

a) It captures the concept of a hybrid approach to discrete& continuous computation. 

h) It complements Type-2 oracle computation: 

In the discrete realm, every function / : N — ^ N becomes computable when employing an 
appropriate oracle; whereas in the Type-2 case, exactly the continuous functions / : R ^ M 
are computable relative to some oracle [ZiegOS, COROLLARY 6]. On the other hand, 2-wise 
advice can make a continuous function computable which without advice has unbounded 
degree of uncomputability; see Proposition 8d). 

c) Discrete advice avoids a common major point of criticism against Recursive Analysis, 
namely that it denounces even simplest discontinuous functions as uncomputahle; 

d) and such kind of advice is very practical: In applications additional discrete information 
about the input is often actually available and should be used. For instance a given real 
matrix may be known to be non- degenerate (as is often exploited in numerics) or, slightly 
more generally, to have k eigenvalues coincide for some known k EN. 

1.3 Related Work, in particular Kolmogorov Complexity 

Definition 5 comes from [Weih92, Definition 3.3]; see also [Paul09, Definition 5.8] where 
our quantity Ct(/) it is called '^basesize. Providing discrete advice can also be considered as 
yet another instance of enrichment in mathematics [KrMa82, p. 238/239]. 

Various other approaches have been pursued in the literature in order to make discontin- 
uous functions accessible to nontrivial computability investigations. 

Exact Geometric Computation considers the arguments x as exact rational numbers [LPY05]. 

Special encodings of discontinuous functions motivated by spaces in Functional Analysis, are 
treated e.g. in [ZhWc03]; however these do not admit evaluation. 

Weakened notions of computability may refer to stronger models of computation [ChHo99]; 
provide more information on (e.g. the binary encoding of, rather than rational approxi- 
mations with error bounds to) the argument x [Mori02,MTY05]; or expect less information 
on (e.g. no error bounds for approximations to) the value f{x) [WeZhOO]. 

A taxonomy of discontinuous functions, namely their degrees of Borel measurability, is inves- 
tigated in [Brat05,Zie07a,Zie07b]: 

Specifically, a function f -.C A ^ B is continuous (=Z'i-measurable) iff, for every closed 
T <Z B, its prcimagc f~^[T] is closed in dom(/) C A; and / is computable iff this map- 
ping T <—>■ f~^[T] on closed sets is (V^, V^)-computable. A degree relaxation, / is called 
Z'2-measurable iff, for every closed T C B, f~^[T] is an F^-set. 

Wadge degrees of discontinuity are an (immense) refinement of the above, namely with respect 
to so-called Wadge reducibility; cf. e.g. [WeihOO, Section 8.2]. 

Levels of discontinuity arc studied in [HcWc94,Hcr96a,Hcr96b]: 

Take the set LEV'(/,1) C dom(/) =: LEV'(/,0) of points of discontinuity of / = 
/Ilev'(/,o); then the set LEV'(/, 2) C LEV'(/, 1) of points of discontinuity of /|lev'(/,i) 
and so on: the least index k for which LEV'(/, /c) = holds is /'s level of discontinuity 
Lev'(/). 

A variant, Lev(/), considers LEV(/, 1) the closure of LEV'(/, 1) in dom(/), then LEV(/, 2) 
the closure of points of discontinuity of /|lev(/,i) ^^'^ so on until LEV(/, k) = 0. 
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Our approach superficially resembles the third and last ones above. A minor difference, they 
correspond to ordinal measures whereas the size of the partition considered in Definition 5 
is a cardinal. As a major difference we now establish these measures as logically largely 
independent. 

Proposition 8. a) There exists a 2-computable function f : [0, 1] — > {0, 1} which is not 
measurable nor on any level of discontinuity. 

b) There exists a A2-measurable function f : [0, 1] [0, 1] with is not k-continuous for any 
finite k. 

c) If f is on the k-th level of discontinuity, it is k-continuous; in formula: Ct(/) ^ Lev'(/) < 
Lev(/). 

d) There exists a continuous, 2-computable function f :C [0, 1] [0, 1] which is not com- 
putable, even relative to any prescribed oracle. 

e) Every k- computable function is nonuniformly computable; whereas there are nonuniformly 
computable functions not k-computable for any G N. 

f) There even exists a nonuniformly computable / : M — ^ M with £t(/) = the cardinality 
of the continuum. 

Any real function is trivially c-continuous by partitioning its domain into singletons. Item f) 
is due to Andrej Bauer, personal communication. Item c) appears also in [Paul09, THE- 
OREM 5.10]. The last paragraph of [Paul09, Section 5.1] includes our Item c) and partly 
extends Item a) by exhibiting, to any ordinal A and cardinal /? < A, a function f ^ P 

with Ct(/) = P and Lev(/) = A. Complementing Item e), conditions where nonuniform 
computability does imply (even) 1-computability have been devised in [Brat99] . 

Proof (Proposition 8). 

a) Consider a non Borel-measurable subset S C [0,1]; e.g. exceeding the Borel hierarchy 
[Hinm78,Mosc80] by being complete for A\. (Using the Axiom of Choice, S can even be 
chosen as non Lebesgue-measurable.) Then its characteristic function 1^9 is not measur- 
able and totally discontinuous, hence [0,1] = LEV'(l5,l) = LEV'(l5,2) = whereas 
(5, [0, 1] \ S) gives a 2-decomposition of dom(l5) with '\.s\s = 1 and l5|[o,i]\s' = 0. 

b) Sec Example 18b) below. 

c) By definition, / is continuous on LEV'(/, 0) \ LEV'(/, 1), on LEV'(/, 1) \ LEV'(/, 2), and 
so on — until LEV'(/, A; — 1) on which / is continuous because LEV'(/, fc) = 0. Therefore 
A = (LEV'(/,0)\LEV'(/,1),LEV'(/,1)\LEV'(/,2),...,LEV'(/,A;- 1)) constitutes a 
partition with the desired properties. 

d) Fix any uncomputable t G [0, 1] and consider 

/:C [0,1] ^ [0,1], /(x) := for X < t, /(x) := 1 for x > t, f{t):=l. 

which is obviously continuous (because the 'jump' x = t is not part of dom(/)) and 2- 
computable (namely on [0, t) and (t, 1]). Since t is uncomputable, t Q. So if / were 
computable, we could evaluate it at any a; € Q to conclude whether x < t oi x > t] and 
apply bisection to compute t itself: contradiction. In fact we may choose t uncomputable 
relative to any prescribed oracle [ZhWe01,Barm03]. 

e) Let f\j^ be computable on each D ^ A. Then f{x) is computable for each computable 
x & D; hence also for each computable x G dom(/) = |J Z\. 

Example 18b) below has range {0}U{l//c : fc G N} consisting of computable (even rational) 
numbers only. 
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f) Consider a Sierpihski-Zygmund Function [KharOO, Theorem 5.2] / : M — > M, i.e. such that 
f\D is discontinuous for any D C dom(/) of Card(Z)) = c. Observe that this property is 
not affected by arbitrary modifications of / on any subset X C dom(/) of Card(X) < c: 
If the restriction /|dom(/)\x is continuous on D\X for some D C dom(/) of Card(D) = c, 
then so is / on \ X — contradicting Card(L' \ X) = c. 

We may therefore modify the original function to be, say, identicaUy on the countable 
subset X := Rc of recursive reals, thus rendering nonuniformly computable. Now suppose 
A is any partition of M of Card{A) < c. Then, by [CoLa93, Exercise 7.13], 

c = Card(R) = ^ Card(D) = max ( Card(Z\), sup£)g^ Card(£))) 

requires Card(L') = c for some D G A; but /|d is discontinuous, hence Ct(/) > c. □ 
Further related research includes 

Computational Complexity of real functions; see e.g. [Ko91] and [WeihOO, SECTION 7]. Note, 

however, that Definition 5 refers to a purely information-theoietic notion of complexity 

of a function and is therefore more in the spirit of 
Information-based Complexity in the sense of [TWW88]. There, on the other hand, inputs are 

considered as real number entities given exactly; whereas we consider approximations to 

real inputs enhanced with discrete advice. 
Finite Continuity is being studied for Darhoux Functions in [MaPa02,Marc07]. It amounts to 

d-continuity for some G N according to Definition 5a). 
Kolmogorov Complexity has been investigated for finite strings and, asymptotically, for infinite 

ones; cf. e.g. [LiVi97, Section 2.5] and [Stai99]. Also a kind of advice is part of that theory 

in form of conditional complexity [LiVi97, Definition 2.1.2]. 

We quote from [LiVi97, EXERCISE 2.3.4abc] the following 

Fact 9. An infinite string a = {an)neoj G is computable (e.g. printed onto a one-way 
output tape by some so-called Type-2 or monotone machine; cf. [WeihOO, Schm02]j 

0-) iff its initial segments ai-n ■= (ui, . . . have Kolmogorov complexity < 0{1) condition- 
ally to n, i.e., iff C(fJi:„|n) is bounded by some c = c{a) G N independent of n. 

b) Equivalently: the uniform complexity Cu(ai;„) := C(ai:„;n) in the sense o/ [LiVi97, Ex- 
ercise 2.3.3] is bounded by some c for infinitely many n. 

Recall that C(fTi:„; n) is defined as the least size of a program computing any (not necessarily 
proper) extension of the function {l,...,n} 3 i ^ fij [LiVi97, EXERCISE 2.1.12]; i.e. in 
contrast to C(ai:„|n), only lower bounds i to n are provided. 

Proof ( Claim b). If fj is computable by some machine M, then obviously a minor (and constant 
size) modification M' of it will, given n G N, print ai:n- Hence Cu(ai:„) < |(M')|. 
Concerning the converse implication, observe that there are only 0{1Y machines of size < c. 
And for each of the infinitely many n, at least one of them prints all initial segments of length 
up to n. Hence by pigeonhole principle, a single one of them does so for infinitely many n. 
Which implies it does so even for all n. □ 

Definition 10. a) For a € , write C(ct) := sup„ C(fTi:„|n) and C{(j\f) := sup„ C(fTi:„|n, f ) , 
where the Kolmogorov complexity conditional to an infinite string is defined literally as 
for a finite one [LiVi97, Definition 2.1.1]. 
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b) Similarly, let Cu(a'|f) := sup„ Cu(a'i:„|f). 

c) For a represented space {A, a) and a e A, write C{a) := inf{C(cj) : a(a-) = a} and 
Cu(a) := inf{Cu(a) : a{a) = a}. 

Note that we purposely do not consider some normalized form like C(ai:„|ra)/n in order to 
establish the following 



Proposition 11. A function F :C E"^ is computable with finite advice iff the Kol- 

mogorov complexity Cu(-F(a)|a) is bounded by some c independent of a & dom(F). 

It seems that (at least the proof in [Lovl69] of) Fact 9a) is 'too non- uniform' for Proposition 11 
to hold with Cu replaced by C, even for compact dom(F). 

Proof. Suppose a F{a) is computable for a e Di by Turing machine Mj. Then obviously 
Cu[F{a)\a) < \{Mi)\ + |bin(i)| is bounded independent of i < d. 

Conversely consider, as in the proof of Fact 9b), the d < 0{iy machines Mj of size < c; and 
remember that, for each a G dom(F) and given a, some Mj outputs the entire (as opposed 
to just some initial segments of the) infinite string F{a). Let Di C dom(F) denote the set 
of those a for which Mj does so. Then Mj computes and dom(F) = U^=i-^i' ^ is 

computable with d-fold advice. □ 



2 Properties of the Complexity of Non-uniform Computability 

Lemma 12. a) Let f : A ^ B be d-continuous (computable) and A' C A. Then the restric- 
tion f\Ai is again d-continuous (computable). 

b) Let f : A ^ B be d-continuous (com,putable) and g : B ^ C be k-continuous (computable). 
Then g o f : A ^ C is d- k-continuous (computable). 

c) If f : A ^ B is {a, P) -computable with d-wise advice and a' ^ a and (3 ■< (3' , then f is 
also {a' , 13') -computable with d-wise advice. 

Proof, a) Obviously, any partition A oi A induces one A' := {D D A' : D & A} of A' of at 
most the same cardinality. 

b) If / is continuous (computable) on C ^ and g is continuous (computable) on Bj C B, 
then go f is continuous (computable) on Ai n f~^[Bj]: f is on any subset of Ai] and so is 
g on any subset of Bj, particularly on the image of A^ n f~^[Bj] C Bj under /. 

c) obvious. □ 

A minimum size partition A of dom(/) to make / computable on each D E A need not be 
unique: Alternative to Example 1, we 

Remark 13. Given a p-name of x E and indicating whether [x\ E 7, is even or odd 
suffices to compute [x\ : 

Suppose [x\ = 2A; G 2Z (the odd case proceeds analogously). Then x G [2k,2k+l). Conversely, 
X £ [2k — 1,2k + 2), together with the promise [x\ G 2Z, implies [xj = 2k. Hence, given 
(<?n) £ Q with \x — qn\ < 2~"-, k := 2 ■ \_qi/2 + |J (calculated in exact rational arithmetic) will 
yield the answer. □ 
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2.1 Witness of fc-Discontinuity 

Recall that the partition A in Definition 5 need not satisfy any (e.g. topological regularity) 
conditions. The following notion turns out as useful in lower bounding the cardinality of such 
a partition: 

Definition 14. a) A d-dimensional flag in a topological Hausdorff space X is a collection 

^1 (^n)„ ) (.^n,m)„,m ) {^n,m,i)n,m,i ' • • • ' (■^ni,...,nd)ni,...,n^ 

of a point and of (multi-) sequences^ in X such that, for each (possibly empty) multi-index 
n G N'^' (0 < k < d), it holds Xn = lim Xn m ■ 

m—foo ' 

h) T is uniform if furthermore, again for each nGN*^ (0 < k < d) and for each 1 < £ < d — k, 
it holds Xfi = lim Xnm m ■ 

m— >oo 'Os^^^ 

i times 

c) For f -.C X ^ Y and x G dom(/) a witness of discontinuity of f at x is a sequence 
Xn G dom(/) such that lim„^oo f{xn) exists but differs from f{x). 

d) For f '.C. X ^ Y , a witness of d-discontinuity of f is a uniform d-dimensional flag T 
in dom(/) such that, for each k = 0, 1, ... ,d — 1 and for each ft E and for each 
1 < i < d — k, (xfi^^^...^^)^ is a witness of discontinuity of f at Xn. 

i times 

Observe that, since d is finite, we may always (although not effectively) proceed from a flag 
to a uniform one by iteratively taking appropriate subsequences. In fact, sub (multi) sequences 
of d-flags and of witnesses of discontinuity are again d-flags and witnesses of discontinuity. 

Example 15. Consider the mapping Card^ : M" 9 (xi, . . . ^Xd) ^ Cardjxi, . . . ,Xrf} and let 
X := (0^), Xn := (l/n,0^-i), Xn,m := (1/n, 1/n + l/m,0'^-2), Xn,,...,n, := (l/ni,l/ni + 

l/n2,...,l/niH hl/nfejO'^"''). Then obviously \im„i Xn^,...,nk,m,...,m = -X'ni,...,nfe, hence we 

have a uniform d-dimensional flag. Moreover Cardd{Xni,...,nk) = k + 1 for k = 0,1, . . . ,d—l. 
shows it to be a witness of {d — 1)- discontinuity. 

Observe that Card^ is trivially d-continuous, namely even constant on each Z)^ := {(xi, . . . , x^) : 
Card{xi, . . . , x^} = k^ , k = 1, . . . , d. In. fact d is best possible as we have, justifying the notion 
introduced in Definition 14c), the following 

Lemma 16. Let X, Y be Hausdorff, f : X Y a function, and suppose there exists a witness 
of d-discontinuity of f. Then £t(/) > d. 

It also follows that Example 3c) is best possible: Knowing k := Cardjxi, . . . , Xd} £ {1, . . . ,d} 
(i.e. ci-wise advice according to Example 15) is necessary for the computability of the members 
without repetition of the (however) given set {xi, . . . , Xd}, that is of a p*^-name of (xjj , . . . , x^j,) 
with k = Cardjxi^ , . . . , Xj^ } . Whereas computability of its members with repetition does not 
require any advice according to [WeihOO, Lemma 5.1.10], anyway. 

* The generally more appropriate concept is that of a Moore-Smith sequence or net. However, being inter- 
ested in second countable spaces, we may and shall restrict to ordinary sequences. Similarly, the Hausdorff 
condition is invoked for mere convenience. 
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Proof (Lemma 16). Suppose dom(/) = l+J^=i -Dj is a partition such that f\Di is continuous; 
w.l.o.g. X G Di. 

Now consider the sequence (x„) in the flag: Xn G UiLi Di imphes by pigeonhole that some 
Di contains infinitely many (w.l.o.g. all) x„; and f{\\mnXn) = f{x) 7^ lim„_>oo /(a^n) requires 
i 7^ 1 in order for to be continuous. W.l.o.g. i = 2. 

We proceed to the double sequence (xn,m) in the flag: For each n G N, some -Di(„) 3 Xn,m for 
inflnitely many m; and /(lim^Xn,^) = ^ lim„/(xn,m) requires i{n) 7^ 2 for f\Di^„) to 

be continuous. Moreover some i = i{n) for infinitely many n; hence f {limm Xm,m) = f{x) ^ 
lini,m f {xm,m) also requires 17^!. W.l.o.g. i = 3. 

And so on until i ^ 1,2,3, ... ,d: contradiction. □ 



2.2 Three Examples 



Observe that for an ATx M-matrix A and d := min(A^, M), rank (A) is an integer between and 
d; and knowing this number makes rank trivially computable. Conversely, such (d + l)-fold 
information is necessary, as follows from Lemma 16 in connection with 



Example 17. Consider the space 
For i E {0,1, . . . ,d} write 
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of rectangular matrices and let d := min(A?^, M). 
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has lim^^oo ^ni,...,ni,m,...,m = Xni,...,ni) hence constitutes a uniform d-dimensional flag. More- 



over, rank(£^j) = i = rank(X„j^...^„ 
of d- discontinuity o/rank : M.^^^ 



y^i + l = rank(Xi 

.{0,1,..., 4. 



ni,...,ni,m,...,m 

t times 



) shows it to be a witness 

□ 



Example 18. Fix some bijection N x N ^ N, {x,y) {x,y); e.g. {x,y) := 2^ • (1 + 2y). 

a) For n G N*, let (n) := 2~^*'"»^; and map the empty tuple to 0. 

This mapping ( • ) : N* ^ [0, 1] is injective and maps to dyadic rationals. For each k eN, 
the range (N'^) belongs to A2; {N^'') is even closed a subset of [0, 1] . 

b) Consider f : [0, 1] — >■ [0, 1] well-defined by f{x) := 1/k for x = {ft) with n G N'^; f{x) := 
for X (N*). Then f is A2-measurable but not d-continuous for any d G N. 

Proof (Example 18). 
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Fig. 2. Schematic illustration of the topology of the subspaces of rank-fe matrices, fe = 0, 1, 2, 3. 

a) Since the sum ^j<j^. is finite for n G N'^, (n) amounts to a dyadic rational, namely one 
with at most k occurrences of the digit 1; the latter constitute a closed set. 

b) Well-definition of / follows from a). Moreover, f^^{l/k) = (N^) is in A2. Since range(/) = 
{l/k : k G N}U {0}, the preimage /~^[V^] of any open set F ^ is a union of finitely many 
f^^{l/k) and therefore in A2, too; Whereas the preimage of open V 3 misses finitely 
many f^^{l/k) and thus also belongs to A2. 

Let X := 0, x„ := 2-<i'">, Xn,m := + 2-<2,rn)^ ...^ Xn„...,n, := Eti2-<''"*^- 

This constitutes a uniform d-dimensional flag. And /(.x„j^^ ,1^. ) = l/k ^ 1/ik + £) = 
f{xni,...,nk,m,...,m) shows it to be a witness of d-discontinuity of /. □ 

^ times 

Recall Example 4 of computing (or rather identifying) from a given A^-tuple (aji, . . . , a^jv) 
of distinct points in M.'^ those extremal to (i.e. minimal and spanning) the convex hull 
chull(a;i, . . . , xat). In the ID case, this problem (xi, . . . , xn) ^ extchulliv(a;i, . . . , xn) is com- 
putable: simply return the two (distinct!) numbers min{a;i, . . . ,xn} and max{xi, . . . ,xn}- 
We have already seen that in 2D it generally lacks V^-computability because of discontinuity. 

Proposition 19. Let xi, . . . ,X]\[ G M*^ be pairwise distinct and C := chull(a;i, . . . ,X]\f). 

a) Let y G ext(C). Then there exists a closed half space 

with rational normal (although not necessarily unit) vector u G Q*^ \ {0} and t > Q such 
that n {xi, . . . ,Xn} = {y} = {xj} for some I < j < N . 

b) Conversely H^t ^ • • • > *iv} = {^il ^^^^ w / implies Xj G ext(C). 

c) Given Xi, . . . , xjv G M.'^ as above and for I < j < N , "xj G ext(C) " is semi-decidable. 

d) The mapping extchulljv from Equation 2 is [p*^^^ ,1/^) -computable. 
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e) For N > 2 and given the number M := Cardext(C) G {2, . . . , A^} of extreme points, the 
set of their indices, i. e. 

{n,...,ZM} C {l,...,Ar} s.t. ext(C) = {asii, . . . ,03,^} 

becomes {p"^^^ ,1^) -computable. 

In particular, cxtchuUjv is {p'^^^ -computable with (N — l)-wise advice. 

f) It is however {N — 2)-wise {p*^^^ -discontinuous in dimensions d>2. 

Proof, d) Follows from c) by trying all j = 1, . . . ,N. Indeed, a V^^-name (but not a i/^-name) 
permits to 'increase' at any time the set to be output. 

e) similarly to d), now trying all M-tuples (ii < ^2 < • • • < ^m) in {!> • • • ,^}- Note that 
indeed Cardext(C) > 2 because the Xi are pairwise distinct. 

c) Follows from a+b) by dovetailed search for some tt G \ {0} with {u, Xj) =:t> {u, Xi) 
for all i ^ J, where (w, x) := uixi + • • • + UdX^. 

a) and b): It is well-known [Gruc67] that extreme points y of a polytope C (although not 
necessarily of a general convex body) are precisely its exposed points, i.e. satisfy {y} = 
C n H^^ for some t > and u G M \ {0}. Equivalently: {u, xj) > {u, Xi) for all i ^ j — 
obviously a condition open in u, which therefore may be chosen from the dense subset 

f) We might construct a witness of (iV — 2)-discontinuity, but take the more elegant ap- 
proach of a reduction by virtue of Lemma 12b). To this end observe that semi-decidability 
of mequality makes Card^M" 3 (xi,...,x„) Cardjxi, . . . , rcn} (p", /?<)-computable, 
i.e. upper semi-continuous; hence by Example 15, Card^ must be (n— l)-wise lower semi- 
discontinuous. 

Now let xi, . . . , x„ G M be given. According to [WeihOO, Exercise 4.3.15] suppose w.l.o.g. 
x\ > X2 > ■ ■ ■ > Xn-1 > Xn = 0. Then proceed to the following collection X of (n -|- 1) 
points in 2D: (0,0), (l,xi), (2,xi + X2), ... , (n - l,xi + • • • + .x„_i), (n,x„); cf. Fig- 
ure 3. Let fn '. — > M^^("'+^) denote this computable mapping (xi,...,x„) 1-^ X. 
Observe that the sequence of slopes from points #i to #i + 1 is non-increasing be- 
cause Xi > Xj+i; and two successive slopes (#z — 1 — > #i) and (#? — #i + 1) co- 
incide iff Xi = Xj+i; which in turn is equivalent to point ^i not being extreme to 
chull(X). In fact from a ^-name of extchull(X) one can semi-decide (i,xi + • • • + Xj) 
extchull(X); cf. e.g. [Zieg04, Lemma 25c]. This yields a (V^, p>)-computable mapping 
hn : extchull„+i(X) 1— Card extchull„+i (X) = Cardjxi, . . . , x„} defined on the image 
of extchull„+i o/„. Now since /i„ o extchull„+i o/„ = Card : {1, . . . ,n} is (n — 1)- 

wise lower semi-discontinuous by the above considerations. Lemma 12b) requires that 
extchull„+i be (n — l)-wise (p"+^, ■i/^)~discontinuous. □ 



2.3 Further Remarks 

For some time the author had felt that when dom(/) is sufficiently 'nice' and for x G dom(/), 
the cardinal of discontinuity of / could be lower bounded in terms of the number of distinct 
limits of / at X, that is the cardinality of 



Lim(/, x) := { lim„_oo f{xn) ■ dom(/) 3 Xn ^ x} 
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Fig. 3. Knowing in 2D which points are/not extreme to their convex hull can be used to conclude which real 
numbers are in-/equal: 



However the following example (cf. also the right part of Figure 4) shows that this is not the 



case: 



/ : [-1, 1] ^ [0, 1], 2"" • 3"™ ^ 3"™ (n, m G N), f{x) := otherwise . 

Here Lim(/, 0) is infinite but / is continuous on Di := {2~" • 3~"^ : n,m G N} (because the 
latter set contains no accumulation point) and / = on D2 := [—1, 1] \ Di; hence £t(/) = 2. 



"Ax) 



o* • • • • • 

CM • • • • • 

m • • • • • 



Fig. 4. Left: the cardinal of discontinuity cannot be lower bounded by the number of limit points. Right: A 
2-continuous function which, after identifying arguments a; = and a; = 1, exhibits mere 3-continuity. 



In order to apply Lemma 16 for proving /c-discontinuity of a function f : A ^ B, it may help 
to compactify the co-domain: 

Example 20. Consider f : [0,1] ^ R, ^ 0, < x ^ 1/x. 

Then f admits no witness of 1-discontinuity; 

whereas / : [0, 1] — M U {+00} does admit such a witness. 

The crucial point is of course that x := and Xn := 1/n constitutes a witness of 1-discontinuity 
only for /, because = /(x) 7^ lim„ = -|-oo exists only in RU {-|-oo}. Finally we remark 
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that the notation 6 in Definition 5b) is usuaUy straight-forward and natural; although an 
artificially bad choice is possible even for 2-wise computable functions: 

Example 21. The characteristic function xh '■ N {0, 1} of the Halting problem H C.'M is 
obviously 2-wise {u^u) -computable by virtue of A = {if, N \ H}, namely for 6 -.C. U* ^ A 
with 1^ H and(}^N\H. 

Whereas with respect to the following notation S, xh is equally obviously not {v, S, v) -computable: 
5:E*^A, X ^ H for X e H, x^N\H forx^ H . 

2.4 Weak A;- wise Advice 

Recalling Observation 6, (weak) fc-wise (a, /?)-computability of f :C A ^ B implies (weak) k- 
wisc (a, /3) -continuity from which in turn follows weak k-wise {a, /3)-continuity in the following 

sense: 

Definition 22. Consider a function f : B between represented spaces {A, a) and {B,P). 

a) Call f k-wise {a, /3)-continuous if there exists a partition A of dom(/) of Card(zl) = k 
such that fli) is (a, f])- continuous on each D £ A. 

b) Call f weakly k-wise {a, 13) -continuous if there exists a k-continuous {a, (3)-realizer F :C 
Z"^ ^ Z"^ of f in the sense of [WeihOO, Definition 3.1.3]. 

c) Call f weakly k-wise {a, pi)- computable if it admits a k-computable {a, P)-realizer. 

However conversely, and as opposed to the classical case k = 1, weak 2-wise (a, /?)-continuity 
in generally does not imply 2-wisc (a, /3)-continuity. Basically the reason is that a partition of 
dom(/) yields a partition of dom(F); whereas a partition A of dom(F) need not be compatible 
with the representation in that different a names for the same argument a may belong to 
different elements of A: 

Example 23. Consider the following function depicted to the right of Figure 4 

/ : [0,1] ^ [-1,-M], [0,l)nQ3 x>-^ x=: g{x), R\q 3 x x-1 =: h{x), /(I) := 0. 

It is continuous on both Q PI [0, 1) and on {1} U R \ Q; hence 2-continuous, and admits a 
2-continuous (p, p)-realizer. 

Now proceed from [0,1] to , i.e. identify x = with x = 1; formally, consider the 
representation p := lo p -.C. S'^ — ^ where z : M — »• [0, 1), x i— ^ x mod 1. Since /(O) = = 
/(I), this induces a well-defined function f : ^ [— 1,+1]; which admits a 2-continuous 
(p, p)-realizer: namely the 2-continuous (p, p)-realizer of f . But f itself is not 2-continuous: 
Suppose = Di\^ D2 where f\Dx and f\D2 o,Te both continuous. W.l.o.g. G Di. Observe 
that /(O) = = g{0) 7^ h{Q) = —1. Hence, as Q is dense and because continuous h is different 
from continuous g, continuity of f\£)-^^ requires it to coincide with g: first just locally at x = 0, 
but then also globally — which implies lim floiix) = g{l) = 1, contradicting /|di(1) =0. □ 

As already mentioned. Example 23 illustrates that the implication from fc-wise (a, /3)-continuity 
to weak k-wise {a, ^)-continuity cannot be reversed in general — even for admissible represen- 
tations. Indeed, p can be shown equivalent to the standard representation 6gi of as an 
effective topological space [WeihOO, Definition 3.2.2]. 

Applying Lemma 12 to realizers yields the following counterpart for weak advice: 
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Remark 24. Fix represented spaces (A, a), (B,(3), and (C, 7). 

a) Let f : A ^ B be weakly d-wise {a, 13) -continuous /computable and A' C A. Then the 
restriction f\A' is again weakly d-wise {a, P)- continuous/computable. 

b) Let f : A ^ B be weakly d-wise {a, (3) -continuous /computable and g : B ^ C be weakly 
k-wise {(5^^) -continuous /computable. Then g o f : A ^ C is weakly d- k-wise {a,j)- 
continuous / computable. 

c) If f : A ^ B is weakly d-wise (a, P)- continuous (computable) and a' :<t a (a' :< a) and 
(3 :<t P' (P :< P'), then f is also weakly d-wise {a' , P') -continuous (computable). 

Notice that property b) does not carry over to mw/ii-representations in the sense of [WeihOS] ; 
cf. the discussion proceeding Lemma 28 below. 

We also observe that Lemma 16 does not admit a converse, even for total functions between 
compact spaces: 

Observation 25. The function / : 5^ — > [— 1,+1] from Example 23 is not 2-continuous yet 

has no witness of 2- discontinuity. 

Proof. Suppose {x, (a:„^„j)} is a witness of 2-discontinuity of /. First consider the 

• case X G (0,1) n Q. Since a;„ — > x and x = f{x) / lim„/(xn,), w.l.o.g. < x^, < 1 
and Xn ^ Q: otherwise proceed to an appropriate subsequence. Now lim^x„^^ = Xn 
and hm„ f{xn,m) / /(.x„) = x„ - 1 requires, by definition of /, f{xn,m) — ^n.m for 
almost all m and n: contradicting that a witness of discontinuity is required to satisfy 

limm f{Xm,m) ^ f{x) and limmXm,m = X. 

• Case X G (0, 1) \ Q: similarly. 

• Case X = = 1: As — X and since 7^ /(x) 7^ lim„ /(x„) exists, we may consider two 

subcases: 

• Subcase x„ G (1/2, 1) H Q for almost all n: 

Now Xn = lim^x„,:rn and Xn = f{xn) 7^ liTsimf{xn,m) requires, by definition of /, 
fix n;rn) — Xn,m 1 for almost all TTi and n'. contradicting lim^^ Xm^m — x and lim^jj fixm^m 
fix) = 0. 

• Subcase x„ G (0, 1/2) \ Q for almost all n: similarly. □ 
3 Multivalued Functions, i.e. Relations 

Many applications involve functions which are 'non-deterministic' in the sense that, for a 
given input argument x, several values y are acceptable as output; recall e.g. Items i) and ii) 
in Section 1. Also in linear algebra, given a singular matrix A, we want to find some (say 
normed) vector v such that A ■ v = 0. This is reflected by relaxing the mapping f : x y 
to be not a function but a relation (also called multivalued function); writing f : X ^ Y 
instead of / : X — 2^ \ {0} to indicate that for an input x G X, any output y G /(x) is 
acceptable. Many practical problems have been shown computable as multivalued functions 
but admit no computable single- valued so-called selection; cf. e.g. [WcihOO, EXERCISE 5.1.13], 
[ZiBr04, Lemma 12 or Proposition 17], and the left of Figure 5 below. On the other hand, 
even relations often lack computability merely for reasons of continuity — and appropriate 
additional discrete advice renders them computable, recall Example 2 above. 

Now Definition 5 of the complexity of non-uniform computability straight-forwardly ex- 
tends from single-valued to multivalued functions; and Observation 6 relates them to (single- 
valued) realizers; which can then be treated using Lemma 16. However a direct generalization 
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of Lemma 16 to multivalued mappings turns out to be more convenient. This approach re- 
quires a notion of (dis-)continuity for relations rather than for functions. 

3.1 Continuity for Multivalued Mappings 

Like single-valued computable functions (recall the Main Theorem), also computable rela- 
tions satisfy certain topological conditions. However for such multivalued mappings, litera- 
ture knows a variety of easily confusablc notions [ScNeOT]. Hemicontinuity for instance is 
not necessary for real computability; cf. Example 27a) below. It may be tempting to regard 
computing a multivalued mapping / as the task of calculating, given x, the set-value f{x) 
[SpreOS]. In our example applications, however, one wants to capture that a machine is per- 
mitted, given X, to 'nondeterministically' choose and output some value y G fix). Note that 
this coincides with [WeihOO, Definition 3.1.3]. In particular we do not insist that, upon in- 
put X, all y G f{x) occur as output for some nondeterministic choice — as required in [BratOS, 
Section 7]. Instead, let us generalize Definition 14 as follows: 

Definition 26. Fix some possibly multivalued mapping f :Q X ^ Y and write dom(/) := 
{xGX:/(x)/0}. 

Call f continuous at x ^ X if there is some y G f{x) such that for every open neighbourhood 
V of y there exists a neighbourhood U of x such that f{z) fl F 7^ for all z & U. 

For ordinary (i.e. single- valued) functions /, dom(/) amounts to the usual notion; and such 
/ is obviously continuous (at x) iff it is continuous (at x) in the original sense. 



'/3 % 



Fig. 5. Left: A (p, p)-computable relation which is not hemicontinuous nor admits a continuous selection. 
Middle: Quantification over all y € f{x) is generally necessary to capture discontinuity of a multivalued 
function. 



Example 27. a) Consider the left of Figure 5, i.e. the multivalued function 

/ : [0,1] =^ [0,1], l/3>x^{0}, [1/3,2/3) 9 {0,1}, 2/3 < x ^ {1} . 

Then f is neither lower nor upper hemicontinuous — yet [p, p) - continuous, even com- 
putable: Given (qn) ^ Q with \x — g„| < 2~", test q^: if < 1/2 output 0, otherwise 
output 1. Indeed, \x — q^l < 1/8 implies x < 5/8 < 2/3 for q^ < 1/2, hence G /(x); 
whereas 53 > 1/2 implies x > 3/8 > 1/3, hence 1 G f{x). 
b ) Referring to the middle part of Figure 5, the multivalued function 



5: [-1,1] ^[0,1], [-1,0) 9 or ^{0}, 0^[0,1], (0,l]9x^{l} 
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is not continuous at w.r.t. any y G /(O) = [0, 1] although /(O) itself does intersect f{z) 
for all z. 

c ) Consider the right part of Figure 5, i. e. the multivalued function 



Then Xn '.— 2 constitutes a witness of discontinuity of h at x — in the sense of 
Definition 30a) below: For every y G h{x) = [0,1), V := (0, y/2 + 1/2) B y is an open 
neighbourhood of y disjoint from h(xn) = {1} for all n. 

Lemma 12a) literally applies also to multivalued mappings f : B. Similarly generalizing 
Lemma 12b) is quite cumbersome: For B = \J-Bi, the preimages f~^[Bi], 

• if defined as {a G ^ : /(a) C Bi}, need not cover A 

• if defined as {a E A : f{a) f) Bi 7^ 0}, need not be mapped to within Bi by /. 

On the other hand, already the following partial generalization of Lemma 12b) turns out as 
useful: 

Lemma 28. a) Let f : A ^ B be single-valued and g : B ^ C multivalued. If f is d- 
continuous (computable) and g is k-continuous (computable), then g o f : A ^ C is 
{d ■ k)-continuous (computable). 

b) Let f : A ^ B and g : B ^ C be multivalued. If f is d-continuous (computable) and g is 
continuous (computable), then go f : A^ C is again d-continuous (computable). 

Proof, a) Since / is single- valued, the set Ai n f~^[Bj] is unambiguous and mapped by / to 

a subset of Bj; that is the proof of Lemma 12b) carries over, 
b) If / is continuous (computable) on each Ai, then so is 5 o /. □ 

Lemma 31a) below is an immediate extension of the Main Theorem of Recursive Analysis, show- 
ing that any computable multivalued mapping is necessarily continuous. It seems unknown 
whether also the converse, namely the Kreitz-Weihrauch Representation Theorem, extends to 
the multivalued (for a start, real) case: 

Question 29. Is the notion of multivalued continuity in Definition 26 strong enough to assert 
that any function / :C M ^ M satisfying it admits a Cantor- continuous {p, p)-realizer? 

3.2 Witnesses of Discontinuity 

Definition 30. a) For x G dom(/), a witness of discontinuity of f at x is a sequence (a;„) G 
dom(/) converging to x such that, for every y £ f{x) there is some open neighbourhood 
V of y disjoint from f{xn) for infinitely many ra G N. 

b) A uniform d-dimensional flag T in X is a witness of d-discontinuity of f if, for each 
< k < d and for each n G and for each 1 < £ < d — k and for each y G f{xn), 

(^n,m,. ..,m) „ 

is a witness of discontinuity of f at Xn. 



If multivalued / admits a witness of discontinuity at x, then / is not continuous. Conversely, 
if X is first-countable, discontinuity of / at a; yields the existence of a witness of discontinuity 
at X. Also, witnesses of 1-discontinuity coincide with witnesses of discontinuity; and they 
generalize the definition from the single- valued case. Lemma 31 below extends Lemma 16 in 
showing that a witness of d-discontinuity of / inhibits d-computability. 



h:[-l,+l] ^ [0, 1], 



> X 1-^ [0,1), < X {1} . 



i times 
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Lemma 31. Let {A, a) and {B,l3) be effective metric spaces^ with corresponding Cauchy 
representations and f -.C. B a possibly multivalued mapping. 

a) If f admits a witness of discontinuity, then it is not (a, P) -continuous. 

b) If f admits a witness of d-discontinuity, then it is not d-wise {a, (3) -continuous. 

Proof, a) Suppose F :C E'^ — ^ E'^ is a continuous (a, /3)-realizer of /. It maps some a-name 
a of X to a /3-namc r of some y € f{x). Now consider the neighbourhood V B y according 
to Definition 26b). By definition of the Cauchy representation f3, some finite initial part 
(ri, . . . ,tm) ='■ f\<M of f restricts y to belong to V; and by continuity of F, this f\<M 
depends on some finite initial part a\<isr of a. On the other hand a|<jv is also initial part 
of an a-name of some element Xn of the witness of discontinuity; in fact of infinitely many 
of them. But for n sufficiently large, f{xn) was supposed to not meet V; that is f|<M is 
not initial part of a /3-name of any y' G f{xn). contradiction. 

b) combines the arguments for a) with the proof of 16. □ 

In comparison with the single- valued case, a witness of discontinuity of a multivalued mapping 
involves one additional quantifier ranging universally over all y G f{x); and Example 27b) 
shows that this is generally also necessary. Nevertheless, the following tool gives a (weaker 
yet) simpler condition to be applied in Section 4. 

Lemma 32. Fix metric spaces {A,a) and {B,P), e > 0, and f -.C A^ B. 

a) For S,T C A, B{S, e) := {a G A\3s G S : dA{a, s) < e} is disjoint from T iff B{T, e) is 
disjoint from S, and implies B{S,e/2) D B{T, e/2) = 0. 

b) Let Un and Vn denote sequences in dom(/) with lim„ Un = x = lim„ Vn such that B (^f (un) , e) 
is disjoint from f{vn) for all but finitely many n. Then at least one of the sequences is a 
witness of discontinuity of f at x. 

c) For r G N and 1 < i < r, let {x^n)^ denote sequences in dom(/) with lim^Xn^ = x such 
that i?(/(xn''), e) = holds for infinitely many n. Then, for some i, {xn^)^ is a 
witness of discontinuity of f at x. 

d) Fix r, d G N and consider a family of (multi-) sequences 

•^1 •'^ni^' ■^ni,n2^' ■ ■ ■ ' •^ni'...'nd '< l^li ■ ■ • ■> f^d G N, 1 ^ ^1 , . . . , irf ^ J' 

such that, for each i G {!,..., r}'^, (x, ^^^^'^2^ • • • > ^&'-.'-',nd^) constitutes a uniform 
d-dimensional flag. Furthermore suppose that, for each n G N*^ and z G {1, • • • ,r}^ (t) < 
k < d) and for each 1 < i < d — k, 

(3) 

for infinitely many m G N. Then this family contains a witness of d-discontinuity of f. 

Proof a) If t G T n B{S, e), there is some s e S with dA{s, t) < e; hence s G 5 n B{T, e). So 
T n 5(5*, e) 7^ implies S H B{T, e) 7^ 0. The converse implication holds symmetrically. 
For X G B{S, e/2) n B{T, e/2) there exist s G S" and t G T with d(s, x),d(t, x) < e/2; hence 
d{s, t) < e by triangle inequality and s G S* H B{T, e). 

^ Cf. [WeihOO, Section 8.1] for a formal definition and imagine Euclidean spaces as major examples and 
focus of interest for our purpose. 
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b) Suppose conversely that there exists some y € f{x) such that V := B{y,e/2) intersects 
both f{un) and f{vn) for all n > hq. Then y G S((/(ttn), e/2) n (/(fn),e); hence by a), 
B{f{un),e) intersects f{vn)' contradiction. 

c) similarly. 

d) The case r = 1 is that of c). We now treat r = 2, the cases of higher values proceed 
similarly. 

By c) there is some i such that [xn^) constitutes a witness of discontinuity of / at x. 
Now consider the sequences (xnm) for n G N and 1 < j < r. Again by c), to each n 

there is some j(n) G {1, . . . , r} such that (xnm ) is a witness of discontinuity of / at Xn^. 
According to pigeonhole, j[n) = j for some j and for infinitely many n; hence we may 
proceed to an appropriate subsequence of Xn and presume that (xn'm) is a witness of 
discontinuity of / at Xn^ for one common j; and (xm''m) a witness of discontinuity of / 
at x: arriving at [x,Xn\xn',m) a witness of 2-discontinuity of /. □ 

3.3 Example: Rational Approximations vs. Binary Expansion 

It is long known [Turi37] that a sequence of rational approximations to some x G M with error 
bounds cannot contimioiisly be converted into a binary expansion of x. On the other hand 
for non-dyadic reals, i.e. for 

X B := {(2r + l)/2'= :r,A;GZ} , 

such a conversion is computably possible [WeihOO, Theorem 4.1.13.1]; while each rational 
X = r/s has an (ultimately periodic, hence) computable binary expansion [WeihOO, Theo- 
rem 4.1.13.2]. We observe that finding such an expansion for dyadic x is infinitely discon- 
tinuous. Recall that ^ = (0.1000. . .)2 = (0.01111 . . .)2 (and in fact each x G D) admits two 
distinct binary expansions. 

Proposition 33. The multivalued mapping 

oo 

Adic2 : D n [0, 1) ^ {0, 1}'^, Yl ^"^2-"* ^ {h,b2, . . .) 

m=l 

is not d-wise (p, u^) -continuous for any d eN. 

We remark that in fact for each g = 2, 3, 4, . . ., the mapping Adicg extracting g-adic expansions 
is infinitely discontinuous on Q. 

Proof (Proposition 33). Start with the rational sequence ;= (1^ . . .), a p-name of x := ^. 
Then consider the sequence of sequences 

o(+) — C i 1 1 + 2"" i + 2"" \ ■ 

In ■— 2 ' • y ' 2^ ' 2 ^ ' ' • • V • 

n times oo times 

/9-names of x^"^^ := ^-|-2~", since la^n"^ — = 2"" < for £ < n. Moreover, converges 
in the Baire metric to the sequence Similarly, := (^,...,^,^ — 2~", ^ — 2"", . . .) is 
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a p-name of x^^^ ■~ h ~ ^ " converging to And although the binary expansions of 
7^ xii ^ are both not unique, 

4+) = (0.10_^100...)2 = (0.10_^011...)2 

(n — 2) times (n — 2) times 

4"") = (0.01j^l00...)2 = (0.01_^011...)2 

(n — 2) times (ti — 2) times 

shows that for n > 2 they must differ ahcady in the first place. Put differently, for e := 1/2 
and with respect to Cantor metric, i? ( Adic2 (xn^^ ) , e) n B(^Adic2{xn ^),e) = 0: a witness of 
discontinuity according to Lemma 31b). 
Next take 

(±,±) /I 1 1 _|_ 9— n 1 _i_ n—n 1 _i_ n—n _i_ n—n—m 1 /o _i_ 9— n _i_ n—n—m \ 

'dn,m ■— \ 2^--J'2J2^'^ ; • - ; 2 ^ ^ J 3 ' \7 ' " " V 

n times m times 00 times 

as /9-names of xl^^^^ := ^ it 2"" it 2~"'~™' {x,Xn^^ : n € N} converging to qi^^ for 
m ^ 00; and qm,ni^ to g'^-*. Here, any binary expansions of x*^*'^) and of ,t(*'+) must dif- 
fer in position n, i.e i?( Adic2(xn^m ^),e) n B(Adic2(xi%^),e) = for e < 2""; while still 

S ( Adic2 (xn^m ) , e) n S ( Adic2 (xi7"i "* ) ! f ) = for e < 1/2: yielding a witness of 2-discontinuity 
according to Lemma 31d) with r := 2. 
And, continuing, ^t.'.'.'.'.ni — 



ni times n2 times ns times 

. . . , • • • , • • • ; 

1 _l_ 2~"i J; 2~"i~'*2 J; ... J; 2~"^ "d-i 1 -|- 2~"i lb 2~"i~"2 i • • • lb 2~"^ "d-i 



ricj times 

- lb 2~"'^ lb 2~"i~'*^ lb • • • lb 2"^*^ "d-i -|- 2"""^ "d-i— ) 



00 times 



constitutes a compact d-flag of p-names for x^t^\',',''^1 := l/2zb2 "'^±2 

2-ni nd-i g^j^^ witness of d-discontinuity of Adic2. □ 

Now consider the problem Adicg"'* : [0, 1) ^ {0, 1}*^ of computing only the first n bits of the 
binary expansion of x, given by rational approximations with error bounds. Since Adic2(x) 
is in a sense the limit of Adic2"'^(x) converging with 2""" as n — 00, it might seem natural to 
conjecture in view of Proposition 33 that ^c{^^^(^^\ P,^) — 00 for n — 00. Indeed 2^-wise 
advice trivially suffices for computing Adic2"'*(x) G {0, 1}". But one can do much better: 

Observation 34. Adic2"'' : [0,1) ^ {0,1}" is {p,v)~ computable with 2-wise advice; namely 
when giving, in addition to a p-name of x, also the n-th hit of its binary expansion. 



This can be considered an example of a phase transition. (Note however that, implicitly, n is 
given here.) 
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Proof (Observation 34)- Suppose that [0,1) 3 x = Yl^i^i^ * with hi G {0,1} and hn = 0. 
(The other case 6n = 1 proceeds analogously.) Then it holds 

X G [0, 2-^^] U [2 • 2"'^, 3 • 2-""] U • • • U [(2'^ - 2) • 2"^, {T - 1) • 2"'^] , 

corresponding to the 2"~^ possible choices of . . . , bn-i,bn) with 6„ = 0. Conversely 

xG ((2fc-i)-2-",(2A: + |)-2-") for A; G {0, 1, . . . , 2"-^} (4) 

implies (since 6„ = 0) .t G [(2fc) • 2^", (2A; + 1) • 2""] and (6i, . . . ,6.„_i) = bin(/c). As strict 
real inequalities are semi-decidable (formally: p-r.e. open in the sense of [WeihOO, Defini- 
tion 3.1.3.2]), dovetailing can search for k to satisfy Equation (4). □ 

4 Applications 

Based on Lemma 16b), we now determine the complexity of non-uniform computability for 
several concrete functions including the examples from Section 1. 

4.1 Linear Equation Solving 

We first consider the problem of solving a system of linear equations; more precisely of finding 
a nonzero vector in the kernel of a given singular matrix. It is for mere notational convenience 
that we formulate for the case of real matrices: complex ones work just as well. 

Theorem 35. Fix n, m G N, d := min(n,m — 1), and consider the space M"^"* of n x m 
matrices, considered as linear mappings from to M". Then the multivalued mapping 

LinEq„ : A ^ kernel(^) \ {0}, dom(LinEq) := {A G W""^ : rank(^) < d} 

is well-defined and has complexity C^t(LiiiEq„ „j) = £c(LiiiEq„ p"-^™, p™) = d+1. 

Proof. Observe that {0} C kcrncl(j4) C holds iff rank(yl) < m — 1. Also rank(^) < n is 
a tautology. Hence LinEq is totally defined. [ZiBr04, THEOREM 11] has shown that knowing 
rank(yl) G {0,1,..., d} suffices for computably finding a non-zero vector in (and even an 
orthonormal basis of) kernel (A); hence £t (LinEq) < £c (LinEq, p"^"*, p"*) < d + 1. 

Conversely, we apply Lemma 32d) with r := m to assert d-discontinuity of LinEq. 
Start with A := 0"^™, i.e. LinEq(^) = \ {0}. Now Lemma 36a) below for S := 1/N 
yields m sequences A^^\ . . . , A^^^ {N G N) with rank(Aj^'') = 1, all converging to A and with 

f\- kernel(^^'') = {0}; hence LinEq(^j^^) = 0. However, Lemma 32c) requires B(^LmEq{A^j^),e) = 
for some e > 0. On the other hand, observe that vector normalization 

norm:M™\{0} 3 x ^ x/\\x\\ G 5"^"^ 

is single-valued computable and continuous. Hence by Lemma 28b) it suffices to prove {d- 
wise) discontinuity of LinEq' := norm o LinEq. Notice that LinEq'(74) = LinEq(^) fl S"^~^ is 
compact. Thus, now, P|j LinEq(74^-' ) = does imply 



f|.S( LinEq' (4)),e) C s(f|^ LinEq' (^g), <5) = 
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for some appropriate e > according to (an inductive application of) Lemma 36b) below. 
Indeed, e can be chosen independent of N since the subspaces Vi from Lemma 36a) do not 
depend on S. Hence we obtain by Lemma 32c) — in a complicated way — a witness of (1-) dis- 
continuity of LinEq'. 

In case d < 3, again applying Lemma 36a) similarly yields rank-2 matrices ^jv^w — 
1, . . . , m— 1; A^^^ := A^^) with limM ^jviw ~ uniformly in j, N and with kernel ( A j^''^) = 
{0}, hence again Q i?( LinEq' (yl*^*)), e) = for some e > according to Lemma 36b): and thus 
a witness of 2-discontinuity by Lemma 32d). 

We may continue this process until arriving at rank-d matrices ^jvl' 'iv^ ^ witness of 
d-discontinuity. (And we cannot proceed any further because cither d = min(n, m) prohibits 
application of Lemma 36a or, in case d = m — 1, the matrices it yields exceed the domain of 
LinEq.) □ 

The following tool, in addition to completing the proof of Theorem 35, also gives further 
justification for Figure 2: 

Lemma 36. a) Let n,m e N, d := min(n,m), A G M"^"*, r := rank(^) < d. There are 

subspaces Vi, . . . ,Vm-r of with O^Vi = {0} such that, to any 5 > 0, there exist 
A^^\ G IR">^™ with rank(AW) = r + 1, \\A^'^ - ^|| < and kernel(AW) = Vj. 

h) Let X,Y be closed subsets o/M", X compact, and 6 > 0. Then there exists e > such that 
B{X, e) n B{Y, e) C B{X nY,6). 

Proof, a) Since rank(A) < n, there exists some (w.l.o.g. normed) w G M"" \ range(A). More- 
over by the Rank-Nullity Theorem, dimkernel(^) = m — r. So consider an orthonormal 
basis zi, . . . , Zm-r £ of kernel(yl) and linear mappings 

A^^ -.R"" 3 X ^ A-x + S ■ {x, Zi)w : 

These obviously satisfy ||^(*) — ^|| < 6. Moreover it holds range(yl(*'*) = range(A) © 
lspan(i(;) and kernel(A*^*^) = kernel(yl) n zf- =: Vf. because all Zj {j ^ i) are still mapped 
to 0. Hence rank(^(')) = rank(A) + 1 and flj Vi = kernel(^) fl, = {0}. 
b) First consider the disjoint case XCiY = 0. Then the distance function dy from Equation (1) 
is positive on X. Moreover dy is continuous and therefore, on compact X, bounded from 
below by some 2e > 0. Hence B{X, e) n B{Y, e) = 0. 

In the general case, ^ := X n 1" is not necessarily empty but closed. Now consider X' := 

X \ B{Z,5/2) and Y' := Y \ B{Z,5/2): X' is compact and disjoint from closed Y'; 
hence B{X',e) n B{Y' ,e) = for some < e < 5/2 according to the first case. Since 
X C X'uB{Z,6/2), 

B{X,e)nB{Y,e) C B{X' U B{Z,5/2),e) n(B{Y',e)U B{B{Z,6/2),e) ) 

CB{X',e)UB{B{Z,S/2),e) =B{Z,&/2+e)QB{Z,5) 

C { B{X',e) f ^B{Y\e)) U {B{X' ,e) ^ B{Z,5)) VJ {B{Z,5) ^ B{Y,e)) C B{Z,5) 
=0 



□ 
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4.2 Symmetric Matrix Diagonalization 

Similarly to Lemma 36a), we 

Remark 37. Let e > and let A : C"^ C" denote an hermitian linear map with k-fold 
degenerate eigenvalue A G i.e. kernel(A — Aid) = Ispan(ty) © U for some eigenvector w 
(w.l.o.g. of norm 1) orthogonal to a {k — 1) -dimensional subspace U C R". 
Then the linear map ^' : C" — C" with A'\ ^ := A\ ^ and A' -.w ^ {\ + e)w is 

• well-defined and hermitian (and real if A was), 

• has \\A — A'W < € and 

• eigenspace to eigenvalue A cut down to U. 

Moreover, if e is smaller than the difference between any two distinct eigenvalues of A, then 

• X + € is a new eigenvalue 

• with ID eigenspace Ispan(iu) 

• while all other eigenspaces of A' coincide with those of A. □ 




Fig. 6. Breaking 2-fold degeneracy of an eigenspace to ^ = (° °) (left) in two ways Bn = (J °) /N and 
Cjv = (j o)/^ admitting no common eigenvectors (middle and right). 



Theorem 38. Fix d gN and consider the space M'^sJ of real symmetric dx d matrices. Then 
the multivalued mapping 

Diag(i : R^'^) 3 A {('"'i) • • • I'^'d) basis ofMf' of eigenvectors to A} 

has complexity £t(Diagd) = <tc{'Diaga, p^^\ p'^^'^) = d. 

The lack of continuity of the mapping Diag is closely related to inputs with degenerate 
eigenvalues [ZiBr04, Example 18]. In fact our below proof yields a witness of cZ-discontinuity 
by constructing an iterated sequence of symmetry breakings in the sense of Mathematical 
Physics: cf. Figure 7. On the other hand even in the non-degenerate case, Diag is inherently 
multivalued since any permutation of a basis constitutes again a basis. 

Proof (Theorem 38). Let (y{A) C M denote the set (!) of eigenvalues oi A, that is not counting 
multiplicities. [ZiBr04, Theorem 19] has shown that knowing Card(T(A) G {1, . . . ,d} suffices 

to compute some orthonormal basis of eigenvectors; hence £t(L)iag) < Cc(Diag, p^a),^'^^'^) < 
d. 
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Fig. 7. Construction similar to Figure 6, now iterated in 3D. 



For the converse inequality, we shall apply Lemma 32d); but, as in the proof of Theorem 35, 
first invoke Lemma 28b) by appending to Diag a computable mapping: namely orthonormal- 
ization. Indeed, standard Gram-Schmidt constitutes an effective procedure for turning a 
basis into an orthonormal one; and this process respects eigenspaces because those belonging 
to different eigenvalues are mutually orthogonal anyway. In the sequel we will therefore inves- 
tigate the multivalued mapping Diag' : R^'^) z4 0{R, d) to the compact space of orthogonal 
matrices. 

Start with symmetric A := 0''^'^, eigenvalue being d-fold degenerate with eigenspace en- 
tire M*^, d > 2. Now consider two unit vectors v and w neither collincar nor orthogonal. 
According to Remark 37 above there exist corresponding sequences {Bpf)^^ and (Cat)^ of 
symmetric matrices, both converging to A and with (d — l)-fold degenerate eigenspaces 
and further ID ones: Bn ■ v = 1/N ■ v and Cat ■ w = 1/N ■ w; all eigenspaces are in- 
dependent of N. Hence, by Observation 39 below, Bp^ and Cn do not admit a common 
eigenvector basis; i.e. Diag'(i?jv) H Diag' (Cat) = for all N. And Lemma 36b) implies 
5(Diag'(5iv),e) n 5( Diag'(Civ), e) = for some e > independent of A^. See also Fig- 
ure 6. . . 

We have satisfied the prerequisites to Lemma 32b) and hence conclude that there is a witness 
of discontinuity for Diag'. For a witness of 2-discontinuity observe that the above construc- 
tion can be iterated in case d > 3 as depicted in Figure 7: To each Bpj =: A^^^ there exist 
sequences ^jy'^,^ and A^^'^J^ of symmetric matrices converging to A^^^ uniformly in A^ with 
common (d — 2)-fold degenerate eigenspaces and further ones ^^'^ • x^^'^^ = l/M ■ x^^'^^ 
for j = 0,1 where unit vectors x^^'^^ and a;^*^'^^ are neither coUinear nor orthogonal; sim- 
ilarly sequences ^j^';^ and eigenvectors a;^^'-'^ correspond to A^^^ := Cn- Again, it follows 
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5(Diag'(^J''J^),e) n fi(Diag'(Aj'j^), e) = for some e > independent of A^,M; hence 
Lemma 32d) applies. 

And so on, until arriving at a witness of {d— 1) -discontinuity and at matrices ^jvl jv^ll "^^i^ 
1-fold (i.e. non-)degenerate eigenspaces (where we cannot apply Remark 37 any more). □ 

Observation 39. Let B,C e C'^^'' be hermitian matrices. Let B ■ v = Xv and C ■ w = jiw 

denote respective eigenvectors to non-degenerate eigenvalues A and fj,. 

If B and C admit a common eigenvector basis, then v and w are either collinear or orthogonal. 
4.3 Finding Some Eigenvector 

Instead of computing an entire basis of eigenvectors, wc now turn to the problem of deter- 
mining just one arbitrary eigenvector to a given real symmetric matrix. This turns out to be 
considerably less 'complex': 

Theorem 40. For a real symmetric n x n-matrix A, consider the quantity 

m{A) := min { dimkernel(v4 - Aid) : A G (t(^)} G {l,...,n} . 

Given d := [log2mJ G {0, 1, ... , [log2nJ} and a p^'^^ -name of A, one can p^-compute (i.e. 
effectively find) some eigenvector of A. 

The proof employs the following tool about certain combinatorics and computability of finite 
multi-sets. 

Lemma 41. Let (xi,...,x„) denote an n-tuple of real numbers and consider the induced 
partition I := {{1 < i < j } ■ 1 < J < fi} of the index set {1, . . . , n} =: [n] according 

to the equivalence relation i = j Xi = xj. Furthermore let m := min { Card(/) : / G X}. 

a) Consider I C [n] with 1 < Card(/) < 2m such that 

Xi 7^ Xj for all i & I and all j G [n]\I . (5) 

Then I £l. 

b) Suppose k £ N is such that k < m < 2k. Then there exists I & I with k < Card(/) < 2k 
satisfying (5). Conversely every I C [n] with k < Card(I) < 2k satisfying (5) has I Gl. 

c) Given a p^-name of (xi, . . . ,Xn) and given k eN with k < m < 2k, one can computably 
find some I £ I. 

d) Given a p^-name of (xi, . . . ,Xn) and given Card(X), one can compute X. 

Claim c) can be considered a weakening of Claim d) which had been established in [ZiBr04, 
Proposition 20]. 

Proof, a) Take i £ I, i £ J for some .J £ T. Then obviously I ^ J, because j £ J \ I would 
imply Xi = Xj-. contradicting Equation (5). 

It remains to show I C J. Suppose that Xi ^ Xi' for some i' G /. Then i' G J' for some 
J' £ I disjoint to J. Thus condition "x, ^ Xj" fails for all j £ J; and "xj' 7^ Xj" fails 
for all j £ J': i.e. for a total of Card(J) + Card(J') > 2m choices of j £ [n], whereas 
by Equation (5) it is supposed to hold for all j £ [n] \ I: a total of > n — 2m choices — 
contradiction. 
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b) For the first claim, simply choose / G X with Card(/) = m. Concerning the second claim, 
observe that k <m and Card(/) < 2k imply Card(/) < 2m; hence Item a) applies. 

c) Recall that inequality of real numbers is 'semi-decidable'; formally: {{x,y) x ^ y} C. 
M? is p^-Y.e. open in in the sense of [WeihOO, DEFINITION 3.1.3.2]. Hence we may 
simultaneously try every I C [n] with k < Card(I) < 2k and semi-decide Condition (5): 
according to Item b) this will succeed precisely for some I el. □ 

Proof (Theorem 4-0)- Compute according to [ZiBr04, Proposition 17] some (p"-name of 
an) n-tuple of eigenvalues (Ai, . . . , A„) of A, repeated according to their multiplicities. Now 
due to [ZiBr04, Theorem 11], (some eigenvector in) the eigenspace kernel(A — id) can be 
computably found when knowing rank(A— Aj id) (recall Theorem 35), that is the multiplicity of 
Aj in the multi-set (Ai, . . . , A„). To this end we apply Lemma 41c), observing k := 2'^ < m < 2k 
since d = [log2 m\ . □ 

Theorem 42. The multivalued mapping 

EVec„ : M^a) 3 A >—>■ {w eigenvector of A} 
has complexity £t(EVec„) = (^d^^^Cn, p^^h p"') = Llog2 -|- 1. 

Remark 43. a) In K'^"^, the two subspaces U := {(xi, . . . , ,t„j, 0, . . . , 0) : Xi £ K} and 
,Xm,xi, . . . ,Xm.) '■ Xi G IK}, as well as their orthogonal complements U — 
{(0, . . . ,0,a;i, . . .,Xm) : Xi eK} and V-^ = {{xi, . . . ,Xm, -xi, ... , -Xm) ■ Xi G K], have 
dimension m and satisfy {Q} = U f^V = U r\V^ = r\V = r\V^ . 
h) Write W^^'^ := U, wf^ := U^, W^^'^ := V, and ^ := V^. Applying the above construc- 
tion to each of them again, we iteratively obtain inM?'^ subspaces W!^^^'"-'^''^ of dimension 
2d-k (0 < k < d, ie,je = 0,1) with the following properties: 
i) WP±W}P for all t, i' ,3 e {0, lY , i^l!. 



/ " ti,...,ife+i — " ti,...,ifc 
For any choice of Uj G {W^ it holds f]^Ui = {0}. 



Ill 



c) Let ^ : C" — > C" denote an hermitian linear map with 2m-fold degenerate eigenvalue 
A G M. Let W^^^ denote m- dimensional subspaces 0/ kernel (A — Aid) according to Item a), 

i.e. such that W^^'^ and W^^'^ r\W[^'^ = {0} = ^n%^^\ Then to every sufficiently 

small e > and j = 0,1 there is a hermitian linear map Aii) : ^ with 

m A^^M = A\ 

lkcrnel(A-Aid)-L — ^1 kernel(A-A id)-^ 

• p- < e; 

• A^^^ is real if A was. 



^ ^ and W'f^ 

to different eigenvalues distinct from those of A 



^^''^lkemei(yi-Aid) ^'^^ cigcnspaccs Wq and 



In particular, eigenvectors of A^^^ lie in kernel(74 — Aid)^ U Wq ^ U W^''\ 

Proof (Theorem 4^)- Theorem 40 shows that EVcc„ is (d + l)-computable for d := [log2nJ. 
It remains to show the existence of a witness of d-discontinuity, and w.l.o.g. n = 2'^. To this 
end, start with A := and ylj^j"* (j = 0, 1) according to Remark 43c) with e := 1/A^, A := 0, 

m := 2'^~\ It follows EVec(A(^)) C W^^^ U wi^\ thus EVec(yl(o)) n EYec{AW) = 0; hence 
S(EVec(A(°)),5) n S(EVec(A(^)),(5) = for some S > according to Lemma 36b) where 
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EVec := normo EVec : r('^) 5""^ has compact range and, by virtue of Lemma 28b), the 
same complexity of non-uniform computabihty as EVec. This yields, according to Lemma 32b), 
(in a complicated way) a witness of discontinuity of EVec. 

Now iterating Remark 43c) with the subspaces according to Remark 43b), we obtain ma- 
trix sequences An^^''''^'i,'l^ iov I < k < d and ii,...,jfc G {0)1} and ni,...,nk G N with 
EVec(^^^^) C (J_ ^ wP for each j G {0, 1}^; hence 



by Remark 43b(i-iii). Therefore f]j^^Q B {FjVec{A^^\ e) = for some e > according to 
Lemma 36b) . So Lemma 32d) finally yields a witness of d-discontinuity. □ 



4.4 Root Finding 

We now address the effective Intermediate Value Theorem [WeihOO, Theorem 6.3.8.1]. 
Closely related is the problem of selecting from a given closed non-empty interval some point, 
recall Example 3d). Both are treated quantitatively within our complexity-theoretic frame- 
work. 

Specifically concerning Example 3d), observe that any non-degenerate interval [a,b] con- 
tains a rational (and thus computable) point x; and providing an integer numerator and 
denominator of x makes the problem of computably selecting some x from given [a, b] triv- 
ial. On the other hand, rational numbers may require arbitrarily large descriptions; even 
more, there are intervals containing rationals only of such large Kolmogorov Complexity; cf. 
Claim d) of the following 

Remark 44. a) There exists an unbounded function : N — N such that the Kolmogorov 
Complexity C{m) of any integer m > n is at least f{n). 

b) Fix q G {2,3,...}. For x & [0,1) Ci Q, x = r /s = J2i^i(^iQ~^> r,s & Z coprime and 
ai G {0, 1, . . . , g — 1}, C(r, s) and C((aj).) agree up to some constant independent of x 
(but possibly depending on q). 

That is, just like the usual Kolmogorov Complexity (of a binary string or integer) de- 
pending up to an additive constant on the universal machine under consideration [LiVi97, 
Theorem 2.1.1], the complexity C{x) of a rational number x E Q is well-defined up to 
±0{1). 

c) Fora,beQ, C{a + b),C{a - b),C{a ■ b),C{a/b) < C{a) + C{b) + 0{1). 

To every a G Q there exists a G U'^ with C{a) < C{a) -\- 0{1), the latter in the sense of 
Proposition 11. 

d) Let X G M 6e algebraic of degree 2 (e.g. x = ^Jp -\- q for some prime number p £ F and 
q G Q). Then there exists e > such that for all r,s e Z with s > 0, \x — r/s\ > ejs^ . 

e) Given N eN, there exist a, 6 G Q fl [0, 1] such that all x eQCi [a, b] have C{x) > N. 

Proof, a) is from [LiVi97, Theorem 2.3. li]. 

b) On the one hand, a constant-size program can easily convert (r, s) to the sequence (a^); 
hence C((ai).) < C{r,s) -\- c. Concerning a converse inequality, x = Yli^i^iQ^^ ^ Q 
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implies that (oj) . be periodic after some initial segment; i.e. = aj+„ = Oj+2n = ... for 
alH > m; hence 

^ — ^'i<m \ ^ — ^'1=0 ^ ^ / 
=:u =:v 

= u + vq-"'/{q'' -1) 

with u e Q and v, q~'^/{q^ — 1) G Z which can easily be converted into coprime r, s with 
X = r/s. Also both m (the length of the initial segment) and n (the period) need not be 
stored separately but can be sought for computationally within the sequence (a^). 

c) It is easy, and uses only constant size overhead, to combines Turing machines computing 
a and b into ones computing a + b, a — b, a x b, and a/6, respectively. Moreover a machine 
computing numerator and denominator of a can be adapted to calculate a p-name a of a. 

d) is Liouville's Theorem on Diophantine approximation. 

e) Take x G (1/3, 2/3) algebraic of degree 2, e > according to c). Choose < 6 < l/S such 
that ip{\/ej5) > N. Then Q 3 r/s G [x — S,x + 6] requires e/s^ < S, hence s > ^Jej^ and 
C{x) = C{r, s) > C{s) >N. □ 

Note that Remark 44e) applies only to rational numbers; that is [a,b] might still contain, 

say, algebraic reals x of low Kolmogorov complexity. We now extend the claim to computable 
elements: Referring to Proposition 11, Theorem 45b) below shows that, even with the help 
of negative information about (i.e. a ijj^-name of) a given interval [a,b], unbounded discrete 
advice is in general necessary to find (a p-name of) some x G [a, b]. 

Theorem 45. a) Finding a zero of a given continuous function f : [0,1] [— 1,+1] with 
/(O) = —1 and /(I) = +1, that is the multivalued mapping Intermed :C C[0, 1] ^ [0, 1], 

/ ^ /"^[O] on dom(Intermed) := {/ : [0,1] -> [-1,+1] continuous, f (1) = 1 = -/(O)} , 

has (tc(Intermed, [p^p],p) = £t(Intermed) = uj. 
b) Selecting some point from a given co-r.e. closed bounded non- degenerate interval, specifi- 
cally the multivalued mapping 

Select : [a, b] [a, b], dom(Select) := {[a,b] : < a < b < \} , 

is not d-wise {ij^^, p) -continuous for any d G N. 

Discontinuity of Intermed is well-known due to, and to occur for, arguments / which 'hover' 
[WeihOO, Theorem 6.3.2]. We iterate this property to obtain a witness of d-discontinuity for 
arbitrary d G N: 

Remark 46. a) Consider the piecewise linear, continuous function f : [0, 1] — ^ [—1,-1-1], 

f{x) := 3a; - 1 for x G [0, 1/3], f := on [1/3, 2/3], f{x) := 3x - 2 for x G [2/3, 1] . 

Then A := [1/3,5/12] and B := [7/12,2/3] lie in /-^[O] = [1/3,2/3] =: I. Moreover to 
n > there are piecewise linear continuous functions g,h £ dom(Intermed) with g~^[0\ = 
A and h~^[0] = B and \\f — g\\oo, 11/ ~ ^||oo < 1/^/ c/. Figure 8. 
In particular, B(lntermed(5), 1/27) n S(lntermed(/i), 1/27) = 0. 
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Fig. 8. Witness of discontinuity for tlie effective Intermediate Value Theorem. 



b) Let /() := /, /() := /, := g, := A, f!^^ := h, 1^ := B. 

Iterating the above construction we obtain, to every d eN and {ii, . . . ,id) & {0, 1}^, closed 

intervals 

i) of length S"'*"-^ 

ii) with liii'-^'-d-uid) c l(»i.-.»d-i) 

Hi) such that B{l('^'-''d-ifi) ^3-^^-^) n B{l('^'-''d-i'^\3-'^-^) = 0. 
and sequences of functions fni,'...,n^ € dom (Inter med) with 

■ ) Aii,-,ik) _ ^- Aii,-,ik,-,id) 
"^y Jn\,...,nk — U-J^iiiim J ni,...,nk,m,...,m 

v) and (/fc::;;:f)-'[o]=7(^i'-'^<^) 

where (p = ulinim (pm means lirrim^^oo ||</' — </'n||oo ^ 0. 

c) LetACBC M"^ andf-.W^^R continuous with f{x) < dsix) for all x G M"*. Then there 
exists a sequence of continuous functions : M*^ — > M with gi = f and dA{x) = sup^ gi{x): 
namely ge '■= f ■ 1/^ + (1 ~ 1/^) " dA- 

Proof (Theorem 45)- 

a) As has been frequently exploited before [WeiliOO, Section 6.3], / G dom(Intermed) has 
an entire interval of zeros or has some isolated root. In the latter case, such a root can be 
found according to [WeihOO, Theorem 6.3.7]. In the former case, that interval contains 
a rational one — which can be provided explicitly by its numerator and denominator as 
(unbounded) discrete advice. We thus have shown £c(Intermed) < lo. 

Conversely, Remark 46b) implies in connection with Lemma 32d) that Intermed is not 
d-continuous for any d € N. 

b) Consider the intervals '•••'*<«) fxom Remark 46b). However Lemma 32d) does not apply 
directly since the space of closed (non-degenerate) sub-intervals of [0, 1] is, equipped with 
representation t/A> rather than with ip [WeihOO, Theorem 5.2.9], not metric. Instead, we 
resort to Lemma 31 as follows: Suppose F is a (?/^ , p)-realizer of Select and recall that a 
■i/^-name of closed 7^ i? C [0, 1] is a sequence of continuous functions gi : [0, 1] with 
dsix) = sup£ gi{x). By Remark 46c), any (initial segment of) such a name can be slightly 
perturbed to one oi AC B. 

So start with such a sequence g^^ = {gt)^ for /O; then take a sequence of sequences g^^\ 
with g^^\ := g^ ioi i < n and sup£g^\{x) = dj(o){x) according to Remark 46c); that is. 
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{g^f)i is a ^>-name of I^^^ C /O 'resembling' a ^>-name /^^ for ^ < n. In particular, 
= n\ming^^\ uniformly in x and I. Similarly take g^^\ corresponding to 7*^"'^) initially 
resembling /^^ . Because of Remark 46b iii) , Lemma 32b) yields a witness of discontinuity 
for F. 

Now iterate this construction with the intervals /('^I' - '^d) from Remark 46b) to obtain a 
witness of ^-discontinuity according to Lemma 32c) . □ 

5 Conclusion, Extensions, and Perspectives 

We claim that a major source of criticism against Recursive Analysis misses the point: al- 
though computable functions / are necessarily continuous when given approximations to the 
argument x only, most practical /'s do become computable when providing in addition some 
discrete information about x. Such 'advice' usually consists of some very natural and math- 
ematically explicit integer value from a bounded range (e.g. the rank of the matrix under 
consideration) and is readily available in practical applications. 

We have then turned this observation into a complexity theory, investigating the minimum 
size (=cardinal) of the range this discrete information comes from. And we have determined 
this quantity for several simple and natural problems from linear algebra: calculating the rank 
of a given matrix, solving a system of linear equalities, diagonalizing a symmetric matrix, 
and finding some eigenvector to a given symmetric matrix. The latter three are inherently 
multivalued. And they exhibit a considerable difference in complexity: for input matrices of 
format n x n, usually discrete advice of order 0{n) is necessary and sufficient; whereas some 
single eigenvector can be found using only 6'(logn)-fold advice: specifically, the quantity 
[log2 min { dimkernel(^ — Aid) : A G cj(yl)}J . The algorithm exploits this data based on some 
combinatorial considerations — which nicely complement the heavily analytical and topological 
arguments usually dominant in proofs in Recursive Analysis. 

Our lower bound proofs assert ^-discontinuity of the function under consideration. They 
can be extended (yet become even more tedious when trying to do so formally) to weak d- 
discontinuity. Also the major tool for such proofs, namely that of witnesses of d-discontinuity, 
would deserve generalizing from effective metric to computable topological spaces. 

5.1 Non-Integral Advice 

Theorem 35 shows that d-fold advice does not suffice for effectively finding a nontrivial solution 
a; to a homogeneous eqiiation A ■ x = 0; whereas {d + l)-fold advice, namely providing 
rank(^) G {0, . . . ,d}, does suffice. 

• Since the rank can be effectively approximated from below (i.e. is p< -computable) [ZiBr04, 
Theorem 7], it in fact suffices to provide complementing upper approximations (i.e. a 
p>-name) to rank(^). One may say that this constitutes strictly less than {d + l)-fold 
information. 

• Similarly concerning diagonalization of a real symmetric n X n-matrix A, since the number 
Card a{A) of distinct eigenvalues can be effectively approximated from below, it suffices to 
provide only complementing upper approximations — cmp. [ZiBr04, THEOREM 19] — which 
may be regarded as strictly less than n-fold advice. 
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• Similarly, with respect to the problem of finding some eigenvector of A, again strictly less 
than ([log2 nj + l)-fold advice suffices: namely lower approximations to [log2 m{A)\ (with 
m{A) from Theorem 40) based on the following 

Observation 47. The mapping W^^) ^ A>-^ [log2m{A)\ is {p"''^"'~^''^'^ , p>)-computable. 

Proof. Given A, dimkernel(74— A id) = n — rank(^ — Aid) is /)> -computable by [ZiBr04, Theo- 
rem 7i]; hence so is its minimum m{A) over all A G o-{A), cmp. [ZiBr04, Proposition 17] and 
[WeihOO, Exercise 4.2.11]. Now although logg : (0,oo) 3 x ^-^ ln(x)/ln(2) G M is {p>,p>)- 
computable by monotonicity, x i— > [_x\ is of course not. On the other hand, m{A) attains only 
integer values; and the nondecreasing, purely integral function N 9 m i— [log2mJ G No is 
(p> , p> )-computable. □ 

The above examples suggest refining A;-fold advice to non- integral values of k: 

Definition 48. Let f : X ^ Y be a function and Z a topological Tq space. 

a) Call f continuous with Z-advice if there exists a function g : X ^ Z such that the function 
f\3 , defined as follows, is continuous: 

dom(/|3) := {{x,z):xeX,g{x) = z} C X x Z, {x,z)^f{x) . (6) 

b) Let Z be finite and fix some injective notation :C 17* — r of the (finitely many) open 
subsets of Z. Then the representation 6z = Sz,vz Z is defined as follows: 

a G E'^ is a 6z,u-name of z iff it is a v- enumeration (with arbitrary repetition) of all 
open sets containing Z. 

c) For effective metric spaces (X,a) and {Y,P), call f (a, /3)-computable with Z^-advice if 
there exists some g : X ^ Z such that the function f\^ :C. X x Z ^ Y from a) is 
(a X 6 z, P)- computable. 

Restricting Z to discrete spaces, one recovers Definition 5a): 

Lemma 49. For d & N let Z^ denote the set {0,1, . . . ,d — 1} equipped with the discrete 
topology. 

a) A function f : X ^ Y is d-continuous iff' it is continuous with Z^-advice. 

b ) The representation 5z^ of Z^ is computably equivalent to vz^ : Sz^ = vz^ ■ Whereas in 
general, vz is only computably reducible to (but not from) 6z: vz S^z- 

c) A function f : X ^ Y is {a, (3) -computable with d-wise advice iff it is {a, (3) -computable 
with Zd advice. 

d) {Z,6z) is admissible. In particular if {X,a) and {Y, (3) are admissible and it function 
f : X ^Y is {a, fi)- computable with Z-advice, then f is continuous with Z -advice. 

Proof, a) Let A = {Dq, Di, . . . , denote an d-element partition of X such that is 

continuous for each z = 0,1, . . . ,d—l. Define g : X 3 x i— *^the unique z E Zd with x G D^. 
Then, for open V C.Y, 

m-'[V] = \i){f-'[V]ng-'[{z}])x{z} = \i){f\Dj-'[V]x{z} (7) 
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is relatively open in ISzez^z x {^} = dom(/|^), i.e. /|^ continuous. 

Conversely let f\^ be continuous for g : X Zd- Define A := {Dq, Di,. . . , Dd-i} where 
Dz := g'''^[{z}] for z G Zd. Then Equation (7) requires that (/"M^] ^ D^) x {z} be 
open in [J^Dz x {z}. Now Dz x {z} is open by definition of the product topology and 
because z ^ Z^ is discrete, this implies that also the intersection (/|^)~^[^] H {Dz x {z}) = 
{f~^[V] n Dz) X {z} be open in Dz x {z}, i.e. that is open in Dz] hence is 

continuous for each z & Zf^. 

b) Since Z is finite and uz :C Z"* ^ Z is injective, everything is bounded a priori. For 
instance, given a i^z-name o{ z & Z, one can easily produce a pre-stored list of all (finitely 
many) open sets containing this z: thus showing vz ^ ^z- 

For the converse, exploit that Z^ bears the discrete topology and therefore is effectively 
Ti[Weih09]: Given an enumeration of all (finite) open sets Ui containing z G Z^, their 
intersection Ui becomes a singleton after finite time, thereby identifying z. 
In the Sierpihski space S from Example 50a) below, (some 5§-names of) 1 = _L cannot 
continuously be distinguished from (a (Jg-name of) = T. 

c) Suppose that /|_d^ be (a, /3)-computable for each z G Z^. Since Z^ is finite, it follows that 
f\^ : {x,z) I— > f\D^{x) is (a x i^^^, /3)-computable and hence (a x /3)-computable by 
b). 

Conversely let f\^ be {a x (5^^ , /?)-computable. Then, similarly to a) and since each z e Z^, 
is (^2^,-computable, it follows that also the all restrictions /Id^ be (a, /3)-computable for 
z e Zd where Dz = g~^[{z}]. 

d) Observe that Sz coincides with the standard representation of the (finite, hence effec- 
tive) To-space Z; compare [WeihOO, Section 3.2]. Concerning the second claim, [WeihOO, 
Corollary 3.2.12] reveals that /|^' is continuous. □ 

In this sense. Example 1 turns out to suffice with even strictly less^ than 2-fold advice: 

Example 50. a) Consider as Z the Sierpinski space S, i.e. the set {0, 1} equipped with the 
topology |0, {0}, {0, 1}} as open sets. Then the characteristic function of the complement 
of the Halting problem : N ^ § is (z/, 6^)- computable, but 1h itself is not. 

b) The Gaufi Staircase function / := [ • J : M Z is (p, p) -computable with S-advice. 

c) Generalizing S =: §i, denote by Sa the set {0, 1, ... , d} equipped with the following topology: 
(0, {0}, {0, 1}, {0, 1,2},..., {0, 1, 2, . . . , 4}. Then rank : R'^^"^ {0,1, . . . ,d} is (/^^ p)- 
computable with ^^-advice. 

d) For each function / and integer d, continuity / computability with E>d-i-advice implies con- 
tinuity /computability with Sd-advice, implies continuity /computability with Zd-\-i- advice, 
implies continuity /computability with Zd+2-O'dvice. 

On the other hand, the Dirichlet Function 1q : [0, 1] C R — >• {0, 1} is computable with 
Z2-advice but not continuous with Sd-advice for any d GN. 

In view of [ZiBr04, Theorem 11], Example 50c) shows that S(i-advice renders also LinEq„ „j 
computable for d := min(n, m — 1). 

Proof (Example 50). 

a) Simulate the given Turing machine M, and for each step append "{0, 1}" to the (Jg-name 
of 1 = 1]^\h{{M)) to output in case that M does not terminate; whereas if and when M 

^ We refrain from defining reducibility between general To-spaces but refer to Example 50d) for the specific 
spaces Zd and Sd, d €N. 
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does turn out to terminate, start appending "{0}" to the output, thus indeed producing 
a 5s-name of 0. 

Since any 5§-name of must include the set {0} in its enumeration, one can distinguish 
it in finite time from a (5s-name of 1. (5s-computing 1h{{M)) = would thus amount to 
detecting the non-termination of M, contradicting that H is not co-r.e. 

b) Intuitively, "x Z" is semi-decidable; hence suffices to provide only half-sided advice for 
the case "x G Z". Formally, define 5 : R — S as the characteristic function of M \ Z, i.e., 
g:Z3x<-^0andg: M\Z 3 x 1. Observe dom(/|9) = (Z x {0}) l+l (R\Z x {!}) . Hence, 

foryGN, it is = ((y, y + 1) x {!}) W ({y} x {0}) with (y,y + l)x{l} = 

{{y,y + l)x§)r\dom{f\!^) and {y} x {0} = {iRx {0}) r\dom{f\s) both open in dom(/|^'). 
E> :< Z2 can be seen from the mapping i : Z2 —>■ S with 1— > and 1 1— >■ 1 being trivially 
continuous since Z2 has the discrete topology. Conversely, both surjective mappings from 
S to Z2 arc discontinuous; hence 7^ S. 

c) The identity mapping id : Z^.+i{0, 1, . . . ,k} {0, 1, . . . ,k} = S^, is surjective and trivially 
continuous, hence ^ ^fc+i holds. Similarly, E>k-i :^ Sk is established by the surjection 
/ijfc : Sfe — Sfc_i defined asO<i<-^i — 1 and 1—^ 0, whose continuity follows from 
h^^[{0,l,...,i}] = {0, 1,... + 1} for < i < fc. 

Let g := rank : R*^^*^ S^. Then it holds rank \'^'^^^{A, i) = rank(A) = i on dom(rank |''^'^'^) = 
{{A,i) : A G G N,rank(A) = i]. In particular (rank|™'^'')"^[{j}] = {{A : 

rank(^) > j} x {0, 1, . . . , j}) ^ dom(rank |'''^'^'^) is relatively open in dom(rank l^'^iii')^ be- 
cause {A : rank(A) > j} C R*^^*^ is open by [ZiBr04, Theorem 7] and {0, 1, . . . , j} C 
is open by definition. 

d) A function g : X ^ Sd-i is also one (7 : X — > S^/; and each open subset of §>d-i is 
also open in S^] plus Ss^_^ d: holds: Therefore continuity/computability of :C 
X X Sd-i — Y implies continuity/computability of /|^ :C X xE>d^Y. Similarly for Z^+i 
with Zd+2- Moreover, a function g : X E^d can be considered as a function g : X ^ 
Zd+i; and each open subset of Sd is also open in Zd+i; plus ^ ^z^+i holds: Therefore 
continuity/computability of f\^ :C X x — > F implies continuity/computability of :C 
X X Zd+i ^ Y. 

Now suppose IqI^ :C R x S^^ ^ {0)1} is continuous for (/ : M ^ Sd- By Item c) and 
Lemma 49c), IqId^ is continuous (i.e. constant) on each := (/^""^[{z}]; that is, for each 
z = 0,1, . . . ,d, it either holds C Q or Z)^ C R \ Q. First observe that there exist k, £ 
and two sequences Xn G -D^ of rationals and G of irrationals with \xn — yn\ 0. 
Indeed, y„ := y arbitrary irrational belongs to Di for i := g{y); and, since Q is dense, 
there exists (xn) ^ Q with Xn y, where, by pigeon-hole, Xn G for some k and 
infinitely many (by proceeding to a subsequence w.l.o.g. all) n. We treat the case k < i 
{k > £ works similarly). By construction, it holds iQ(yn) = and g{yn) = hence 
{yn,e) G (lQ|^)"M(-i+l)] =: ^ for all n. Since V is open in dom(lQ|9) C R x S^, it 
follows {xn, k) £ V for all sufficiently large n; recall that the topology on E>d has k E U for 
open U C.§,d and k < £ G U. But lQ(a;„) = 1 contradicts {xn, k) & V. □ 

Since S-advice is strictly less than 2-fold advice (Lemma 49 plus Example 50d), and S is 
strictly richer than 1-fold (i.e. no) advice (Example 50b), it is consistent to quantify S-advice 
as (1 -|- ^)-fold. In fact, Z2 and § arc (up to homeomorphism) the only 2-element Tq spaces; 
but according to the second part of Example 50d), Sj^-advice is not more (nor less, for d>2) 
than Z2-advice and hence cannot justly be called {d + ^)-fold. 
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In fact the Definition 5 of integral and cardinal fe-continuity has an important structural 
advantage: the complexities of two functions are always comparable — either Ct(/) < *^t(5'), 
or £t(/) > ^tig), or Ct(/) = ^t{g)', Whereas when refining beyond integral advice, non- 
comparability emerges. In fact Definition 48 has been suggested to be related to Weihrauch 
Degrees with their complicated structure [Weih92,Paul09,BrGu09]. 

On the other hand, Arno Pauly has recently suggested (private communication during 
CCA2009) that at least some of the above lower bound proofs based on the technical and 
(particularly notationally) cumbersome tools of witness of discontinuity can be simplified 
considerably by Weihrauch-reduction [PaulOD, Theorem 5.9] from (some appropriate product 
of) the function MLPO^ [Weih92, Section 5]. 

Question 51. By assigning weights to the advice values z & Z and to the measurable subsets 
o/dom(X), can one obtain a notion of average advice in the spirit of Shannon's entropy? 

5.2 Topologically Restricted Advice 

Definition 5 asks for the number of colour classes needed to make / continuous/computable 
on each such class — unconditional to the topological complexity of the classes themselves: 
in principle, they may be arbitrarily high on the Borel Hierarchy or even non-measurable 
(subject to the axiom of choice). 

From our point of view, determining the discrete advice to (i.e. the colour c of) some 
input X to / is a non-computational process preceeding the evaluation of /. For instance in 
the Finite Element Method approach to solving a partial differential equation on some surface 
S, its discretization via triangulation gives rise to a matrix A known a-priori to have 3-band 
form: its band-width need not be 'computed', nor does one have to explicitly represent the 
subset of all 3-band matrices within the collection of all matrices. In fact, since the optimal 
colour classes themselves (rather than the number of colours) is usually far from unique, this 
freedom may be exploited to choose them not too wild. 

On the other hand. Definition 5 can easily be adapted to take into account topological 
restrictions: 

Definition 52. Let f : A ^ B denote a function between topological spaces A, B (represented 
spaces {A, a) and {B, (3) ); and let .4 C 2"^ denote a class of subsets of A = dom(/). 

a) £t(/; v4) := min { Card(zl) : A C A partition of A, flo is continuous VD G 

b) itc{f,(X,P;A) := min I Card(z:l) : A C A partition of A, f\D is {a, 13) -computable G 

Hence for A := 2'^°™^-^) the powerset of dom(/) one recovers the previous, unrestricted Defi- 
nition 5: (tt{f;2'^°'^(f^) = £t(/) and £c(/, «, ^, 2d°'"(^)) = it^{f,a,P); whereas restricting the 
topology of the colour classes may increase, but not decrease, the number of colours needed: 
Ct{f;A) < Ct{f,13) for B A; similarly for (tc- Also notice that, unless A is closed under 
finite unions and intersections, it may now well matter whether Z\ is a partition or a covering 
of dom(/). 

Concerning the applications considered in Section 4, Corollary 54 below shows that the 
optimal advice (namely the matrix rank and the number of distinct eigenvalues) gives rise 
to topologically very tame colour classes. In order to formalize this claim, recall that for 
a metrizable space X, each level of the Borel Hierarchy 'Et{X),'nt{X) C St(X) U Ilt{X) C 
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5]t_l_i(X)nnt_|_i(X) of open/closed {t = 1) set, F^/Gs {t = 2) sets and so on, is strictly refined 
by the Hausdorff difference hierarchy; wfiose second level 2-11t{X) = 2-Ilt{X) consists of all 
sets of the form U\V with U,V e (equivalently: of the form A\B with A,B e Ili{X)) 

[Kech95, Section 22. E]. We can now strengthen Proposition 8a+c): 

Lemma 53. a) Let X be a metrizable space and f : X ^ Y. Then, in addition to the 
inequalities Ct(/;2-5]2) < e:t(/;2-Si) and Lev' {f) < Lev(/), it also holds Ct{f;2-^2) < 
Lev'(/) and UU\2-i:^) < Lev(/). 

b) The Dirichlet Function, i.e. the characteristic function 1q : [0,1] C R {0,1}, has 
€c{1q, p,p; 2-'E2) = e:t(lQ;2-5]2) = 2 6wi Lev'(lQ) = Lev(lQ) = oo. 

c) Let f : X ^ Y be such that f\ij is continuous on open U C. X. Then it holds LEV(/, 1) C 
X \ U ; and the prerequisite that U be open is essential. 

d) More generally, ifUi C X \ {Ui U • • • U Ui^i) is relatively open and f\u^ continuous thereon 
for all i < k, then LEV(/, k) C X \{UiU ■ ■ ■ UUk). 

Proof a) Recall that / is continuous on LEV(/, i) \LEV(/, i + 1) where LEV(/, 0) = dom(/) 
and LEV(/, i + 1) = {x G LEV(/, : /|LEV(/,j) discontinuous at a;} is closed, i.e. belongs 
to ni(LEV(/,i)) C ni(dom(/)); hence LEV(/, i) \ LEV(/, z + 1) G 2-ni constitutes a 
Lev(/)-element partition of dom(/) as required. 

For the case of Lev'(/), recall that the set LEV'(/, i + 1) of discontinuities of /|LEV'(/,i) 
is always F^-, i.e. in 5]2(LEV'(/, z)); and by induction in 5]2(dom(/)) since F^- sets are 
closed under finite intersection. Now proceed as above. 

b) Observe that, since Q G F^, both Q n [0, 1] and [0, 1] \ Q belong to 2-X;2, thus showing 
(2:c(1q;2-5]2) = 2. 

However the subset LEV'(/, 1) of discontinuities of 1q coincides with [0, 1] = LEV'(/, 0); 

therefore it holds [0, 1] = LEV'(/, k) = LEV(/, fc) / for all (even transfinite) k. 

c) From [Hcr96b, Lemma 2.5.3], it follows that U is disjoint from LEV'(/, 1), i.e. LEV'(/, 1) C 
X \ U a, closed set; therefore LEV(/, 1) = LEV'(/, 1), the least closed set containing 
LEV'(/, 1), is a subset of X \ C/. 

Recall from b) the example of 1q : [0, 1] {0, 1} continuous on Q, yet Q is certainly not 
disjoint from LEV(1q, 1) = LEV'(1q, 1) = [0, 1]. 

d) proceeds by induction on k, the case k = 1 been handled in c). First observe that 
LEV(/, k + 1) = LEV(/|lev(/,A;)) 1) since the topological closure implicit on the left hand 
side coincides with the closure relative to (closed) LEV(/, k) on the right hand side. More- 
over, the induction hypothesis LEV(/, k) C X\(UiL) - ■ - UUk) implies LEV(/|LEV(/.fe)) 1) — 
LEV(/x\((7iU -uf7fc)) 1) by [Her96b, Lemma 2.5.4], which is in turn contained in [X\{UiU 
• • • U Uk)) \ Uk+i according to c). □ 

Lemma 53a+b) indicates that the greedy meta-algorithm underlying the definitions of Lev(/) 
and Lev'(/) yields topologically mild colour classes on the one hand, but on the other hand not 
necessarily the least number. For the problems in linear algebra considered above, however, 
greedy is optimal: 

Corollary 54. a) Fix n, m G N and recall from Theorem 35 the problem LinEq^^^ of finding 
to a given A G R"^x"^ o/rank(^) < d := min(n,m — 1) some non-zero x G such that 
A- X ^0. It holds 

Lev'(LinEq„,^) = Lev(LinEq„,^) = £t(LinEq„,„) = £c(LinEq„,^, p-; 2-Si) = d+1. 
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b) Fix d G N and recall from Theorem 38 the problem Diag,^ of finding to a given real 
symmetric d x d-matrix A a basis of eigenvectors. It holds 

Lev'(DiagJ = Lev(DiagJ = CtCDiagJ = C:c(Diagrf,p'^-('^-i)/2,p«'x'^;2-5]i) = d . 

c) Fix n G N and recall from Theorem J^2 the -problem EVec„ of finding, to a given real 
symmetric d x d-matrix A, some eigenvector. It holds 

Lev'(EVec„) = Lev(EVec„) = £t(EVec„) = £c(EVeCn, p'*; 2-Ei) = [logsnj+l . 

More precisely, the class 2-5]i of pairwise differences of open sets above may be replaced by 
the class 2Si of pairwise differences of r.e. open sets, i.e. by the second Hausdorff level on 
the ground level Si of the effective Borel Hierarchy. 

Proof, a) Tfieorem 35 refers to arbitrary colour classes and shows that, there, d-fold advice 
is insufficient to continuity: Ct(LinEq„ ,„) > d. In view of Lemma 53a) it thus suffices to 
show Lev(LinEq^^) <d+l. Indeed, the set rank~^(> k) of matrices of rank at least k is 
effectively open a subset of X := M**^™ because A ^ rank(yl) is lower-computable [ZiBr04, 
Theorem 7i]. In particular, Ua-k+i '■= Vk '■= rank"^(fc) = rank~^(> k) nrank~^(< k) 
is effectively open in rank~^(< k) = dom(LinEq„ „j) \ (V^ U • • • U V^+i); and LinEq„ „.j is 
computable and continuous thereon by [ZiBr04, THEOREM 11]. Now apply Lemma 53d) 
to conclude LEV(LinEq„ d + 1) C dom(LinEq„ „,) \ (V^ U • • • U Vq) = 0- 

b) Similarly to a) and in view of Theorem 38 it suffices to show Lev(Diagrf) < d. Now, again, 
the set Vfc := {A : Cardcr(^) = k} = {A : Card ct(^) > k} n {A : Cardcr(^) < k} of 
symmetric real d x d-matrices A with exactly k distinct eigenvalues is effectively open in 
{A : Card<T(yl) < k} = dom(Diagrf) \ (V^ U • • • U V^+i): because A i-^ Card<T(^) is lower- 
computable and lower-continuous [ZiBr04, PROPOSITION 17]. And Diag^ is computable 
and continuous on Vfc by [ZiBr04, THEOREM 19], so Lemma 53d) yields the claim. 

c) Again, in order to show Lev(EVec„) < [log2 nj + 1, consider the sets Uk ■= {A G 
]^n-(n-i)/2 . |^log2m(^)J = A)}, = 0, . . . , [log2 nJ , on which EVec^ is computable by 
Theorem 40. This time {^4 : [log2m(^)J < k} (rather than "> /c") are, according 
Observation 47, effectively open subsets of dom(EVec„). Hence Uk is relatively open in 
{A : |_log2 m{A)\ > k} = M" ("-i)/2 \ (i/o U • • • U Uk-i): now apply Lemma 53d). □ 

In the discrete realm, the Church-Turing Hypothesis is generally accepted and bridges the gap 
between computational practice and formal recursion theory: 

every function which would naturally be regarded as computable is computable under 
his definition, i.e. by one of his (i.e. Turing's) machines [Klee52, p. 376] 

In the real number setting, the Type-2 Machine has not attained such universal acceptance — 
mostly due to its inability to compute any discontinuous function. Hence we propose the 
following as a real counterpart to the discrete Church- Turing Hypothesis: 

The class of real functions f which would naturally be regarded as computable coincides 
with those functions computable by a Type-2 Machine with finite discrete advice of 
colour classes in 2-1^1 (dom/). 

Question 55. a) Is the rank the (up to permutation) unique least advice rendering LinEq 
computable/continuous? 
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b) Is the number of distinct eigenvalues the (up to permutation) unique least advice rendering 
Diag computable/ continuous? 

c) More generally, what are sufficient conditions for the sets LEV(/, i) (i = 1, . . . , Lev(/)j 
to be the unique least-size partition o/dom(/) into subsets where f is continuous? 

Recall that in the proof of Corollary 54, we have repeatedly employed Lemma 53d) giving a 
sufficient condition for the sets LEV(/, i) to constitute a least-size partition of dom(/) into 
subsets where / is continuous. 
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